Sep 11 06:08:45 devstack cinder-volume[77126]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 11 06:08:45 devstack cinder-volume[77126]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 06:08:45 devstack cinder-volume[77126]: we strongly recommend against using it for new projects.
Sep 11 06:08:45 devstack cinder-volume[77126]: If you are already using Eventlet, we recommend migrating to a different
Sep 11 06:08:45 devstack cinder-volume[77126]: framework.  For more detail see
Sep 11 06:08:45 devstack cinder-volume[77126]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 06:08:45 devstack cinder-volume[77126]:   import eventlet  # noqa
Sep 11 06:08:47 devstack cinder-volume[77126]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 06:08:47 devstack cinder-volume[77126]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 06:08:47 devstack cinder-volume[77126]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 06:08:48 devstack cinder-volume[77126]: INFO dbcounter [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Registered counter for database cinder
Sep 11 06:08:48 devstack cinder-volume[77126]: DEBUG oslo_db.sqlalchemy.engines [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:08:49 devstack cinder-volume[77126]: DEBUG dbcounter [-] [77126] Writer thread running {{(pid=77126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 06:08:49 devstack cinder-volume[77126]: INFO cinder.rpc [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 11 06:08:49 devstack cinder-volume[77126]: INFO cinder.rpc [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 11 06:08:49 devstack cinder-volume[77126]: DEBUG oslo_db.sqlalchemy.engines [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:08:49 devstack cinder-volume[77126]: INFO cinder.volume.manager [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Determined volume DB was empty at startup.
Sep 11 06:08:49 devstack cinder-volume[77126]: DEBUG cinder.volume.manager [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77126) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 11 06:08:49 devstack cinder-volume[77126]: INFO cinder.volume.manager [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 11 06:08:49 devstack cinder-volume[77126]: WARNING stevedore.named [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 06:08:49 devstack cinder-volume[77126]: WARNING castellan.key_manager [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 06:08:49 devstack cinder-volume[77126]: WARNING cinder.keymgr.conf_key_mgr [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 06:08:49 devstack cinder-volume[77126]: DEBUG cinder.volume.drivers.lvm [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77126) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 11 06:08:49 devstack cinder-volume[77126]: DEBUG oslo_concurrency.processutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:49 devstack cinder-volume[77126]: DEBUG oslo_concurrency.processutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=77126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:49 devstack cinder-volume[77126]: DEBUG oslo_db.sqlalchemy.engines [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:08:49 devstack cinder-volume[77126]: INFO cinder.rpc [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 11 06:08:49 devstack cinder-volume[77126]: INFO cinder.rpc [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 11 06:08:49 devstack cinder-volume[77126]: WARNING stevedore.named [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 06:08:49 devstack cinder-volume[77126]: WARNING castellan.key_manager [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 06:08:50 devstack cinder-volume[77126]: INFO cinder.volume.manager [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_db.sqlalchemy.engines [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:08:50 devstack cinder-volume[77126]: INFO oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Starting 1 workers
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Started child 77276 {{(pid=77126) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Full set of CONF: {{(pid=77126) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] ******************************************************************************** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Configuration options gathered from: {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] ================================================================================ {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] allow_availability_zone_fallback = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] allow_compression_on_image_upload = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] allowed_direct_url_schemes     = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] api_rate_limit                 = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] auth_strategy                  = keystone {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] az_cache_duration              = 3600 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_availability_zone      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_host                   = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_name                   = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_stats_polling_interval = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backup_api_class               = cinder.backup.api.API {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backup_name_template           = backup-%s {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backup_use_same_host           = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backup_use_temp_snapshot       = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] chap_password                  = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] chap_username                  =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_internal_tenant_project_id = 32ea3bef8ac2445880d09ae0fd57c128 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_internal_tenant_user_id = f5362a8e85aa40a4bfb9945bef432bd8 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cloned_volume_same_az          = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cluster                        = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] compression_format             = gzip {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] compute_api_class              = cinder.compute.nova.API {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] config_dir                     = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] config_source                  = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] control_exchange               = openstack {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] debug                          = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] default_availability_zone      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] default_group_type             = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] default_volume_type            = lvmdriver-1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77276]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] disk_geometry                  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] driver_client_cert             = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] driver_client_cert_key         = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] driver_data_namespace          = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] driver_ssl_cert_path           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] driver_ssl_cert_verify         = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] driver_use_ssl                 = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] enable_force_upload            = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] enable_new_services            = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] enable_unsupported_driver      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] enforce_multipath_for_image_xfer = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] filter_function                = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_api_insecure            = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_api_ssl_compression     = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_ca_certificates_file    = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_catalog_info            = image:glance:publicURL {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_certfile                = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_keyfile                 = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_num_retries             = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance_request_timeout         = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] goodness_function              = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] graceful_shutdown_timeout      = 5 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] group_api_class                = cinder.group.api.API {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] host                           = devstack {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_compress_on_upload       = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_conversion_address_space_limit = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_conversion_cpu_limit     = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_conversion_disable       = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_upload_use_cinder_backend = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_upload_use_internal_tenant = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_volume_cache_enabled     = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_volume_cache_max_count   = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] image_volume_cache_max_size_gb = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] init_host_max_objects_retrieval = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] iscsi_target_flags             =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] iscsi_write_cache              = on {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] iser_helper                    = tgtadm {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] iser_ip_address                = 192.168.122.132 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] iser_port                      = 3260 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_color                      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_config_append              = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_dir                        = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_file                       = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_options                    = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_rotate_interval            = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_rotate_interval_type       = days {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] log_rotation_type              = none {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] max_age                        = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] max_logfile_count              = 30 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] max_logfile_size_mb            = 200 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] max_over_subscription_ratio    = 20.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] message_reap_interval          = 86400 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] message_ttl                    = 2592000 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] migration_create_volume_timeout_secs = 300 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] monkey_patch                   = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] monkey_patch_modules           = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] my_ip                          = 192.168.122.132 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] no_snapshot_gb_quota           = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] num_iser_scan_tries            = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] num_shell_tries                = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] num_volume_device_scan_tries   = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] nvmeof_conn_info_version       = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] nvmet_ns_id                    = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] nvmet_port_id                  = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] osapi_max_limit                = 1000 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] osapi_volume_ext_list          = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] osapi_volume_listen_port       = 8776 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] osapi_volume_use_ssl           = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] osapi_volume_workers           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] per_volume_size_limit          = -1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] periodic_fuzzy_delay           = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] periodic_interval              = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] public_endpoint                = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] publish_errors                 = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] quota_backup_gigabytes         = 1000 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] quota_backups                  = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] quota_gigabytes                = 1000 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] quota_groups                   = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] quota_snapshots                = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] quota_volumes                  = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] rate_limit_burst               = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] rate_limit_except_level        = CRITICAL {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] rate_limit_interval            = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] reinit_driver_count            = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] replication_device             = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] report_discard_supported       = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] report_interval                = 120 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] reservation_clean_interval     = 86400 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] reservation_expire             = 86400 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] reserved_image_namespaces      = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] reserved_percentage            = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] rpc_response_timeout           = 120 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] run_external_periodic_tasks    = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] scst_target_driver             = iscsi {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] scst_target_iqn_name           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_down_time              = 720 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] shell_completion               = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] snapshot_name_template         = snapshot-%s {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] snapshot_same_host             = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] split_loggers                  = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] state_path                     = /opt/stack/data/cinder {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] storage_availability_zone      = nova {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] storage_protocol               = iSCSI {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] syslog_log_facility            = LOG_USER {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] target_helper                  = lioadm {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] target_ip_address              = 192.168.122.132 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] target_port                    = 3260 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] target_protocol                = iscsi {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] target_secondary_ip_addresses  = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] trace_flags                    = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] transport_url                  = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] until_refresh                  = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] use_chap_auth                  = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] use_default_quota_class        = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] use_journal                    = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] use_json                       = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] use_multipath_for_image_xfer   = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] use_stderr                     = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] use_syslog                     = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] verify_glance_signatures       = enabled {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_api_class               = cinder.volume.api.API {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_backend_name            = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_clear                   = zero {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_clear_ionice            = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_clear_size              = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_copy_bps_limit          = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_dd_blocksize            = 1M {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_name_template           = volume-%s {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_service_inithost_offload = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volume_usage_audit_period      = month {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] zoning_mode                    = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_concurrency.disable_process_locking = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.auth_section = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.auth_type   = password {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.auth_version = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.cache       = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.certfile    = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.include_service_catalog = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.insecure    = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.interface   = public {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.keyfile     = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_password = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcache_username = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.region_name = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.service_type = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.backend                  = dogpile.cache.null {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.backend_argument         = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.backend_expiration_time  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.config_prefix            = cache.oslo {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.debug_cache_backend      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.enable_retry_client      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.enable_socket_keepalive  = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.enabled                  = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.expiration_time          = 600 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: INFO cinder.volume.manager [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.hashclient_retry_attempts = 2 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.memcache_dead_retry      = 300 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.memcache_sasl_enabled    = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.password                 = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.proxies                  = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.redis_db                 = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.redis_server             = localhost:6379 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.retry_attempts           = 2 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.retry_delay              = 0.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.socket_keepalive_count   = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.socket_keepalive_idle    = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.socket_keepalive_interval = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.socket_timeout           = 1.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.tls_allowed_ciphers      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.tls_cafile               = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.tls_certfile             = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.tls_enabled              = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.tls_keyfile              = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cache.username                 = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] coordination.backend_url       = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.asyncio_connection    = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.asyncio_slave_connection = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.backend               = sqlalchemy {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.connection            = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.connection_debug      = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.connection_parameters =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.connection_recycle_time = 3600 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.connection_trace      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.db_inc_retry_interval = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.db_max_retries        = 20 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.db_max_retry_interval = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.db_retry_interval     = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.max_overflow          = 50 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.max_pool_size         = 5 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.max_retries           = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.mysql_wsrep_sync_wait = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.pool_timeout          = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.retry_interval        = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.slave_connection      = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.sqlite_synchronous    = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.synchronous_reader    = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] database.use_db_reconnect      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_tracing.insecure = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.connection_string     = messaging:// {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.enabled               = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.es_doc_type           = notification {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.es_scroll_size        = 10000 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.es_scroll_time        = 2m {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.filter_error_trace    = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.hmac_keys             = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.sentinel_service_name = mymaster {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.socket_timeout        = 0.1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.trace_requests        = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler.trace_sqlalchemy      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler_jaeger.process_tags   = {} {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler_jaeger.service_name_prefix = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] profiler_otlp.service_name_prefix = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.enforce_new_defaults = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.policy_default_rule = default {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] privsep_osbrick.group          = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] privsep_osbrick.helper_command = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] privsep_osbrick.user           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_sys_admin.group         = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_sys_admin.helper_command = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] cinder_sys_admin.user          = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.auth_section      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.auth_type         = password {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.cafile            = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.certfile          = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.collect_timing    = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.insecure          = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.keyfile           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.send_service_user_token = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.split_loggers     = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.timeout           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.tls_ciphers       = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] service_user.tls_min_version   = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.auth_section            = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.auth_type               = password {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.certfile                = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.collect_timing          = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.insecure                = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.keyfile                 = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.region_name             = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.split_loggers           = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.timeout                 = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.tls_ciphers             = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] glance.tls_min_version         = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.backend_availability_zone = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.chap_password = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.chap_username =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.disk_geometry = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.driver_client_cert = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.driver_client_cert_key = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.driver_data_namespace = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.driver_use_ssl = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.extra_capabilities = {} {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.filter_function = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.goodness_function = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.iscsi_target_flags =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.iscsi_write_cache = on {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.iser_helper   = tgtadm {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.iser_port     = 3260 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.lvm_share_target = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.lvm_type      = auto {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.num_shell_tries = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.replication_device = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.report_discard_supported = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.reserved_percentage = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.target_helper = tgtadm {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.target_port   = 3260 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.target_protocol = iscsi {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.trace_flags   = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.unique_fqdn_network = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.use_chap_auth = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_backend_name = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_clear  = zero {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_clear_ionice = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_clear_size = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.065s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_reports.file_event_handler = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_reports.log_dir           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.backend_host       = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.chap_password      = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.chap_username      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.disk_geometry      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.driver_client_cert = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.extra_capabilities = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.filter_function    = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.goodness_function  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.iser_helper        = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.iser_ip_address    = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.iser_port          = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.lvm_share_target   = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.lvm_type           = auto {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.num_shell_tries    = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.replication_device = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.report_discard_supported = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.reserved_percentage = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.scst_target_driver = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.storage_protocol   = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.target_helper      = lioadm {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.target_ip_address  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.target_port        = 3260 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.trace_flags        = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.use_chap_auth      = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_clear       = zero {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_clear_size  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] lvmdriver-1.volumes_dir        = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_notifications.driver = [] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_notifications.retry = -1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] key_manager.fixed_key          = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.barbican_api_version  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.barbican_endpoint     = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.barbican_endpoint_type = public {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.barbican_region_name  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.cafile                = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.certfile              = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.collect_timing        = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.insecure              = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.keyfile               = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.number_of_retries     = 60 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.retry_delay           = 1 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.send_service_user_token = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.split_loggers         = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.timeout               = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.tls_ciphers           = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.tls_min_version       = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.verify_ssl            = True {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican.verify_ssl_path       = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.auth_section = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.auth_type = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.cafile   = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.certfile = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.collect_timing = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.insecure = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.keyfile  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.split_loggers = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.timeout  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.tls_ciphers = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] barbican_service_user.tls_min_version = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.approle_role_id          = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.approle_secret_id        = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.auth_method              = approle {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.auth_path                = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.kv_mountpoint            = secret {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.kv_path                  = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.kv_version               = 2 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.namespace                = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.root_token_id            = **** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.ssl_ca_crt_file          = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.timeout                  = 60.0 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.token_file               = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.token_role               = None {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.use_ssl                  = False {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:08:50 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] ******************************************************************************** {{(pid=77126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 11 06:08:50 devstack sudo[77299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 11 06:08:50 devstack sudo[77299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:50 devstack sudo[77299]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:50 devstack sudo[77422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:50 devstack sudo[77422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:50 devstack sudo[77422]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:08:50 devstack cinder-volume[77276]: INFO cinder.brick.local_dev.lvm [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 11 06:08:50 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:51 devstack sudo[77511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:08:51 devstack sudo[77511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:51 devstack sudo[77511]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG cinder.brick.local_dev.lvm [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77276) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:51 devstack sudo[77591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:51 devstack sudo[77591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:51 devstack sudo[77591]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:51 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:51 devstack sudo[77771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:51 devstack sudo[77771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:52 devstack sudo[77771]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.330s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:52 devstack sudo[77889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 11 06:08:52 devstack sudo[77889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:52 devstack sudo[77889]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.259s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:52 devstack sudo[77892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:08:52 devstack sudo[77892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:52 devstack sudo[77892]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:52 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:52 devstack sudo[77976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:08:52 devstack sudo[77976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:52 devstack sudo[77976]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:53 devstack sudo[77980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:08:53 devstack sudo[77980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:53 devstack sudo[77980]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:53 devstack sudo[78068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:53 devstack sudo[78068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:53 devstack sudo[78068]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:53 devstack sudo[78078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:53 devstack sudo[78078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:53 devstack sudo[78078]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:53 devstack cinder-volume[77276]: INFO cinder.volume.drivers.lvm [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:53 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:53 devstack sudo[78082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:53 devstack sudo[78082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:54 devstack sudo[78082]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG cinder.volume.drivers.lvm [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Updating volume stats {{(pid=77276) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:54 devstack sudo[78085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:08:54 devstack sudo[78085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:54 devstack sudo[78085]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:54 devstack sudo[78088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:08:54 devstack sudo[78088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:54 devstack sudo[78088]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:54 devstack sudo[78091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:54 devstack sudo[78091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:54 devstack sudo[78091]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:54 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:54 devstack sudo[78094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:08:54 devstack sudo[78094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:55 devstack sudo[78094]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:55 devstack cinder-volume[77276]: INFO cinder.volume.driver [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Driver hasn't implemented _init_vendor_properties()
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG cinder.volume.driver [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77276) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG oslo_db.sqlalchemy.engines [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG dbcounter [-] [77276] Writer thread running {{(pid=77276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG cinder.db.api [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Building query based on filter {{(pid=77276) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG cinder.image.image_utils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77276) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 11 06:08:55 devstack cinder-volume[77276]: INFO cinder.keymgr.migration [None req-e01f8a81-1f98-4500-972a-c02e900d901f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG cinder.volume.drivers.lvm [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Updating volume stats {{(pid=77276) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:55 devstack sudo[78097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:08:55 devstack sudo[78097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:55 devstack sudo[78097]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:55 devstack sudo[78103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:08:55 devstack sudo[78103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:55 devstack sudo[78103]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:55 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:55 devstack sudo[78106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:55 devstack sudo[78106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:56 devstack sudo[78106]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:56 devstack sudo[78109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:08:56 devstack sudo[78109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:56 devstack sudo[78109]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG cinder.manager [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Notifying Schedulers of capabilities ... {{(pid=77276) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:08:56 devstack cinder-volume[77276]: INFO cinder.volume.manager [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Driver initialization completed successfully.
Sep 11 06:08:56 devstack cinder-volume[77276]: INFO cinder.manager [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Initiating service 2 cleanup
Sep 11 06:08:56 devstack cinder-volume[77276]: INFO cinder.manager [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Service 2 cleanup completed.
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG cinder.service [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Creating RPC server for service cinder-volume {{(pid=77276) start /opt/stack/cinder/cinder/service.py:231}}
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG cinder.service [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77276) start /opt/stack/cinder/cinder/service.py:237}}
Sep 11 06:08:56 devstack cinder-volume[77276]: INFO cinder.volume.manager [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG cinder.volume.drivers.lvm [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Updating volume stats {{(pid=77276) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:56 devstack sudo[78112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:08:56 devstack sudo[78112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:56 devstack sudo[78112]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:56 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:56 devstack sudo[78121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:08:56 devstack sudo[78121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:57 devstack sudo[78121]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:57 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:57 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:57 devstack sudo[78124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:08:57 devstack sudo[78124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:57 devstack sudo[78124]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:57 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:57 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:08:57 devstack sudo[78127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:08:57 devstack sudo[78127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:08:57 devstack sudo[78127]: pam_unix(sudo:session): session closed for user root
Sep 11 06:08:57 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:08:57 devstack cinder-volume[77276]: INFO cinder.volume.manager [None req-487121a1-114c-435a-94a8-2e9d6b21c67c None None] Driver post RPC initialization completed successfully.
Sep 11 06:09:00 devstack cinder-volume[77126]: DEBUG dbcounter [-] [77126] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:09:07 devstack cinder-volume[77276]: DEBUG dbcounter [-] [77276] Writing DB stats cinder:SELECT=5 {{(pid=77276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:09:07 devstack cinder-volume[77276]: DEBUG dbcounter [-] [77276] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:09:07 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager._thread_info {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:09:07 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread count: 6 {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:09:07 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread info: [<_MainThread(MainThread, started 136750024913024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136749912521856)>, <Thread(Thread-3 (stat_writer), started daemon 136749913613888)>, <Thread(Rabbit-heartbeat, started daemon 136749909379200)>, <Thread(Thread-5 (_runner), started daemon 136749911495552)>, <Thread(Thread-7 (_runner), started daemon 136749907492928)>] {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:10:07 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:10:07 devstack cinder-volume[77276]: DEBUG cinder.volume.drivers.lvm [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Updating volume stats {{(pid=77276) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 06:10:07 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:10:07 devstack sudo[80296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:10:07 devstack sudo[80296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:10:08 devstack sudo[80296]: pam_unix(sudo:session): session closed for user root
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:10:08 devstack sudo[80299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:10:08 devstack sudo[80299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:10:08 devstack sudo[80299]: pam_unix(sudo:session): session closed for user root
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:10:08 devstack sudo[80371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:10:08 devstack sudo[80371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:10:08 devstack sudo[80371]: pam_unix(sudo:session): session closed for user root
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:10:08 devstack sudo[80374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:10:08 devstack sudo[80374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:10:08 devstack sudo[80374]: pam_unix(sudo:session): session closed for user root
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG cinder.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Notifying Schedulers of capabilities ... {{(pid=77276) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager._thread_info {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread count: 6 {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:10:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread info: [<_MainThread(MainThread, started 136750024913024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136749912521856)>, <Thread(Thread-3 (stat_writer), started daemon 136749913613888)>, <Thread(Rabbit-heartbeat, started daemon 136749909379200)>, <Thread(Thread-5 (_runner), started daemon 136749911495552)>, <Thread(Thread-7 (_runner), started daemon 136749907492928)>] {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:11:07 devstack cinder-volume[77276]: DEBUG dbcounter [-] [77276] Writing DB stats cinder:SELECT=1 {{(pid=77276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:11:07 devstack cinder-volume[77276]: DEBUG dbcounter [-] [77276] Writing DB stats cinder:UPDATE=1 {{(pid=77276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:11:07 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:11:07 devstack cinder-volume[77276]: DEBUG cinder.volume.drivers.lvm [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Updating volume stats {{(pid=77276) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 06:11:07 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:11:07 devstack sudo[83623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:11:07 devstack sudo[83623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:11:08 devstack sudo[83623]: pam_unix(sudo:session): session closed for user root
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:11:08 devstack sudo[83665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:11:08 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:11:08 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:11:08 devstack sudo[83670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:11:08 devstack sudo[83670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:11:08 devstack sudo[83670]: pam_unix(sudo:session): session closed for user root
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:11:08 devstack sudo[83677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:11:08 devstack sudo[83677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:11:08 devstack sudo[83677]: pam_unix(sudo:session): session closed for user root
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG cinder.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Notifying Schedulers of capabilities ... {{(pid=77276) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager._thread_info {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread count: 6 {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:11:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread info: [<_MainThread(MainThread, started 136750024913024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136749912521856)>, <Thread(Thread-3 (stat_writer), started daemon 136749913613888)>, <Thread(Rabbit-heartbeat, started daemon 136749909379200)>, <Thread(Thread-5 (_runner), started daemon 136749911495552)>, <Thread(Thread-7 (_runner), started daemon 136749907492928)>] {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:12:07 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:12:07 devstack cinder-volume[77276]: DEBUG cinder.volume.drivers.lvm [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Updating volume stats {{(pid=77276) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 06:12:07 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:12:07 devstack sudo[85788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:12:07 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:12:08 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:12:08 devstack sudo[85791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:12:08 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:12:08 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:12:08 devstack sudo[85796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:12:08 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:12:08 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:12:08 devstack sudo[85799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:12:08 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:12:08 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG cinder.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Notifying Schedulers of capabilities ... {{(pid=77276) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager._thread_info {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread count: 6 {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:12:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread info: [<_MainThread(MainThread, started 136750024913024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136749912521856)>, <Thread(Thread-3 (stat_writer), started daemon 136749913613888)>, <Thread(Rabbit-heartbeat, started daemon 136749909379200)>, <Thread(Thread-5 (_runner), started daemon 136749911495552)>, <Thread(Thread-7 (_runner), started daemon 136749907492928)>] {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:13:07 devstack cinder-volume[77276]: DEBUG dbcounter [-] [77276] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77276) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:13:07 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:13:07 devstack cinder-volume[77276]: DEBUG cinder.volume.drivers.lvm [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Updating volume stats {{(pid=77276) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 06:13:07 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:07 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 06:13:07 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:08 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:08 devstack sudo[86909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:13:08 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:08 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:08 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 06:13:08 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:08 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:08 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 06:13:08 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:08 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_concurrency.processutils [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77276) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG cinder.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Notifying Schedulers of capabilities ... {{(pid=77276) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG oslo_service.periodic_task [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] Running periodic task VolumeManager._thread_info {{(pid=77276) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread count: 6 {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:13:08 devstack cinder-volume[77276]: DEBUG cinder.volume.manager [None req-c1f2c848-f2a4-4598-ab2c-4db3cdf462da None None] thread info: [<_MainThread(MainThread, started 136750024913024)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136749912521856)>, <Thread(Thread-3 (stat_writer), started daemon 136749913613888)>, <Thread(Rabbit-heartbeat, started daemon 136749909379200)>, <Thread(Thread-5 (_runner), started daemon 136749911495552)>, <Thread(Thread-7 (_runner), started daemon 136749907492928)>] {{(pid=77276) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:13:17 devstack cinder-volume[77126]: INFO oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Caught SIGTERM, stopping children
Sep 11 06:13:17 devstack cinder-volume[77126]: DEBUG oslo_concurrency.lockutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Acquiring lock "singleton_lock" {{(pid=77126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 06:13:17 devstack cinder-volume[77126]: DEBUG oslo_concurrency.lockutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Acquired lock "singleton_lock" {{(pid=77126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 06:13:17 devstack cinder-volume[77126]: DEBUG oslo_concurrency.lockutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Releasing lock "singleton_lock" {{(pid=77126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 06:13:17 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Stop services. {{(pid=77126) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 11 06:13:17 devstack cinder-volume[77126]: DEBUG oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Killing children. {{(pid=77126) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 11 06:13:17 devstack cinder-volume[77126]: INFO oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Waiting on 1 children to exit
Sep 11 06:13:21 devstack cinder-volume[77276]: DEBUG oslo_concurrency.lockutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Acquiring lock "singleton_lock" {{(pid=77276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 06:13:21 devstack cinder-volume[77276]: DEBUG oslo_concurrency.lockutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Acquired lock "singleton_lock" {{(pid=77276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 06:13:21 devstack cinder-volume[77276]: DEBUG oslo_concurrency.lockutils [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Releasing lock "singleton_lock" {{(pid=77276) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 06:13:21 devstack cinder-volume[77276]: WARNING amqp [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 06:13:21 devstack cinder-volume[77276]: WARNING amqp [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 06:13:21 devstack cinder-volume[77126]: INFO oslo_service.backend._eventlet.service [None req-22b0e6d3-cd2e-4655-b9e8-fdcd55db3db6 None None] Child 77276 exited with status 0
Sep 11 06:13:22 devstack cinder-volume[87298]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 11 06:13:22 devstack cinder-volume[87298]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 06:13:22 devstack cinder-volume[87298]: we strongly recommend against using it for new projects.
Sep 11 06:13:22 devstack cinder-volume[87298]: If you are already using Eventlet, we recommend migrating to a different
Sep 11 06:13:22 devstack cinder-volume[87298]: framework.  For more detail see
Sep 11 06:13:22 devstack cinder-volume[87298]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 06:13:22 devstack cinder-volume[87298]:   import eventlet  # noqa
Sep 11 06:13:24 devstack cinder-volume[87298]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 06:13:24 devstack cinder-volume[87298]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 06:13:24 devstack cinder-volume[87298]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 06:13:24 devstack cinder-volume[87298]: INFO dbcounter [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Registered counter for database cinder
Sep 11 06:13:24 devstack cinder-volume[87298]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG dbcounter [-] [87298] Writer thread running {{(pid=87298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 06:13:25 devstack cinder-volume[87298]: INFO cinder.rpc [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 11 06:13:25 devstack cinder-volume[87298]: INFO cinder.rpc [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:25 devstack cinder-volume[87298]: INFO cinder.volume.manager [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Determined volume DB was empty at startup.
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG cinder.volume.manager [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87298) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 11 06:13:25 devstack cinder-volume[87298]: INFO cinder.volume.manager [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 11 06:13:25 devstack cinder-volume[87298]: WARNING stevedore.named [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 06:13:25 devstack cinder-volume[87298]: WARNING castellan.key_manager [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 06:13:25 devstack cinder-volume[87298]: WARNING cinder.keymgr.conf_key_mgr [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 06:13:25 devstack cinder-volume[87298]: INFO cinder.volume.manager [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:25 devstack cinder-volume[87298]: INFO oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Starting 1 workers
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Started child 87515 {{(pid=87298) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Full set of CONF: {{(pid=87298) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] ******************************************************************************** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Configuration options gathered from: {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] ================================================================================ {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] allow_availability_zone_fallback = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87515]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] allow_compression_on_image_upload = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] allowed_direct_url_schemes     = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] api_rate_limit                 = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] auth_strategy                  = keystone {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_availability_zone      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_host                   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_name                   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_stats_polling_interval = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backup_api_class               = cinder.backup.api.API {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backup_name_template           = backup-%s {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backup_use_same_host           = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backup_use_temp_snapshot       = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] chap_password                  = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] chap_username                  =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_internal_tenant_project_id = 32ea3bef8ac2445880d09ae0fd57c128 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_internal_tenant_user_id = f5362a8e85aa40a4bfb9945bef432bd8 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cluster                        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] compression_format             = gzip {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] compute_api_class              = cinder.compute.nova.API {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] config_dir                     = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] config_source                  = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] control_exchange               = openstack {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] debug                          = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] default_availability_zone      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] default_group_type             = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] default_volume_type            = QuobyteHD {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] disk_geometry                  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] driver_client_cert             = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] driver_client_cert_key         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] driver_data_namespace          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] driver_ssl_cert_path           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] driver_ssl_cert_verify         = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] driver_use_ssl                 = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] enable_new_services            = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] enable_unsupported_driver      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] enabled_backends               = ['QuobyteHD'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] enforce_multipath_for_image_xfer = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] filter_function                = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_api_insecure            = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_api_ssl_compression     = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_ca_certificates_file    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_catalog_info            = image:glance:publicURL {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_certfile                = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_keyfile                 = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_num_retries             = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance_request_timeout         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] goodness_function              = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] graceful_shutdown_timeout      = 5 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] group_api_class                = cinder.group.api.API {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] host                           = devstack {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_compress_on_upload       = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_conversion_address_space_limit = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_conversion_cpu_limit     = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_conversion_disable       = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_upload_use_cinder_backend = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_upload_use_internal_tenant = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_volume_cache_enabled     = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_volume_cache_max_count   = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] image_volume_cache_max_size_gb = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] init_host_max_objects_retrieval = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] instance_format                = [instance: %(uuid)s]  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] iscsi_target_flags             =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] iscsi_write_cache              = on {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] iser_helper                    = tgtadm {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] iser_ip_address                = 192.168.122.132 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] iser_port                      = 3260 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_color                      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_config_append              = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_dir                        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_file                       = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_options                    = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_rotate_interval            = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_rotate_interval_type       = days {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] log_rotation_type              = none {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] max_age                        = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] max_logfile_count              = 30 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] max_logfile_size_mb            = 200 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] max_over_subscription_ratio    = 20.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] message_reap_interval          = 86400 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] message_ttl                    = 2592000 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] migration_create_volume_timeout_secs = 300 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] monkey_patch                   = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] monkey_patch_modules           = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] my_ip                          = 192.168.122.132 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] no_snapshot_gb_quota           = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] num_iser_scan_tries            = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] num_shell_tries                = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] num_volume_device_scan_tries   = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] nvmeof_conn_info_version       = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] nvmet_ns_id                    = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] nvmet_port_id                  = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] osapi_max_limit                = 1000 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] osapi_volume_ext_list          = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] osapi_volume_listen_port       = 8776 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] osapi_volume_use_ssl           = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.remotefs [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87515) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] osapi_volume_workers           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] per_volume_size_limit          = -1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] periodic_fuzzy_delay           = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] periodic_interval              = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] public_endpoint                = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] publish_errors                 = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] quota_backup_gigabytes         = 1000 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] quota_backups                  = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] quota_gigabytes                = 1000 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] quota_groups                   = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] quota_snapshots                = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] quota_volumes                  = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] rate_limit_burst               = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] rate_limit_except_level        = CRITICAL {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] rate_limit_interval            = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] reinit_driver_count            = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] replication_device             = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] report_discard_supported       = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] report_interval                = 120 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] reservation_clean_interval     = 86400 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] reservation_expire             = 86400 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] reserved_image_namespaces      = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] reserved_percentage            = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] rpc_response_timeout           = 120 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] run_external_periodic_tasks    = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] scst_target_driver             = iscsi {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] scst_target_iqn_name           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_down_time              = 720 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] shell_completion               = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] snapshot_name_template         = snapshot-%s {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] split_loggers                  = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] state_path                     = /opt/stack/data/cinder {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] storage_availability_zone      = nova {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] storage_protocol               = iSCSI {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] syslog_log_facility            = LOG_USER {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] target_helper                  = lioadm {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] target_ip_address              = 192.168.122.132 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] target_port                    = 3260 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] target_protocol                = iscsi {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] target_secondary_ip_addresses  = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] trace_flags                    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] transport_url                  = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] until_refresh                  = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] use_chap_auth                  = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] use_default_quota_class        = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] use_journal                    = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] use_json                       = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] use_multipath_for_image_xfer   = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] use_stderr                     = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] use_syslog                     = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] verify_glance_signatures       = enabled {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_api_class               = cinder.volume.api.API {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_backend_name            = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_clear                   = zero {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_clear_ionice            = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_clear_size              = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_copy_bps_limit          = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_dd_blocksize            = 1M {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_name_template           = volume-%s {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_service_inithost_offload = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volume_usage_audit_period      = month {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] zoning_mode                    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_concurrency.disable_process_locking = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.auth_section = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.auth_type   = password {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.auth_version = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.cache       = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.certfile    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.delay_auth_decision = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.http_connect_timeout = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.include_service_catalog = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.insecure    = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.interface   = public {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.keyfile     = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_password = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcache_username = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.region_name = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.service_token_roles_required = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.service_type = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.token_cache_time = 300 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.backend                  = dogpile.cache.null {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.backend_argument         = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.backend_expiration_time  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.config_prefix            = cache.oslo {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.debug_cache_backend      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.enable_retry_client      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.enable_socket_keepalive  = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.enabled                  = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87515) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 11 06:13:25 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 11 06:13:25 devstack cinder-volume[87515]: WARNING cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.expiration_time          = 600 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.hashclient_retry_attempts = 2 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.memcache_dead_retry      = 300 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.memcache_pool_maxsize    = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.memcache_sasl_enabled    = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.password                 = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.proxies                  = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.redis_db                 = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.redis_sentinel_service_name = mymaster {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.redis_server             = localhost:6379 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.retry_attempts           = 2 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.retry_delay              = 0.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.socket_keepalive_count   = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.socket_keepalive_idle    = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.socket_keepalive_interval = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.socket_timeout           = 1.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.tls_allowed_ciphers      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.tls_cafile               = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.tls_certfile             = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.tls_enabled              = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.tls_keyfile              = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cache.username                 = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] coordination.backend_url       = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.asyncio_connection    = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.asyncio_slave_connection = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.backend               = sqlalchemy {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.connection            = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.connection_debug      = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.connection_parameters =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.connection_recycle_time = 3600 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.connection_trace      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.db_inc_retry_interval = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.db_max_retries        = 20 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.db_max_retry_interval = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.db_retry_interval     = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.max_overflow          = 50 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.max_pool_size         = 5 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.max_retries           = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.mysql_wsrep_sync_wait = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.pool_timeout          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.retry_interval        = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.slave_connection      = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.sqlite_synchronous    = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.synchronous_reader    = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] database.use_db_reconnect      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_tracing.insecure = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.connection_string     = messaging:// {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.enabled               = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.es_doc_type           = notification {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.es_scroll_size        = 10000 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.es_scroll_time        = 2m {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.filter_error_trace    = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.hmac_keys             = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.sentinel_service_name = mymaster {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.socket_timeout        = 0.1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.trace_requests        = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler.trace_sqlalchemy      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler_jaeger.process_tags   = {} {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler_jaeger.service_name_prefix = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] profiler_otlp.service_name_prefix = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.enforce_new_defaults = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.policy_default_rule = default {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.policy_file        = policy.yaml {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] privsep_osbrick.group          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] privsep_osbrick.helper_command = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] privsep_osbrick.user           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_sys_admin.group         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_sys_admin.helper_command = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] cinder_sys_admin.user          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.auth_section      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.auth_type         = password {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.cafile            = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.certfile          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.collect_timing    = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.insecure          = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.keyfile           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.send_service_user_token = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.split_loggers     = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.timeout           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.tls_ciphers       = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] service_user.tls_min_version   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.auth_section            = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.auth_type               = password {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.certfile                = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.collect_timing          = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.insecure                = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.keyfile                 = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.region_name             = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.split_loggers           = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.timeout                 = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.tls_ciphers             = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] glance.tls_min_version         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.backend_availability_zone = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.chap_password = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.chap_username =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.disk_geometry = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.driver_client_cert = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.driver_client_cert_key = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.driver_data_namespace = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.driver_use_ssl = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.enable_unsupported_driver = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.extra_capabilities = {} {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.filter_function = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.goodness_function = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.iscsi_target_flags =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.iscsi_write_cache = on {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.iser_helper   = tgtadm {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.iser_port     = 3260 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_host      =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_login     = admin {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: INFO cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 ...
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_mount_options = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd -c /etc/quobyte/client-cinder.cfg {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_password  = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_private_key =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_share_path =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.num_shell_tries = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.nvmet_port_id = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.quobyte_client_cfg = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.quobyte_volume_url = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.replication_device = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.report_discard_supported = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.reserved_percentage = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.scst_target_driver = iscsi {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.scst_target_iqn_name = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.storage_protocol = iSCSI {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.target_helper = tgtadm {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.target_port   = 3260 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.target_protocol = iscsi {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.trace_flags   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.unique_fqdn_network = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.use_chap_auth = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_backend_name = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_clear  = zero {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_clear_ionice = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_clear_size = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack sudo[87521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd -c /etc/quobyte/client-cinder.cfg
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_reports.file_event_handler = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_reports.log_dir           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.backend_availability_zone = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.backend_host         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.chap_password        = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.chap_username        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.chiscsi_conf         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.disk_geometry        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.driver_client_cert   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.driver_client_cert_key = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.driver_data_namespace = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.driver_use_ssl       = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.extra_capabilities   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.filter_function      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.goodness_function    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.iser_helper          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.iser_ip_address      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.iser_port            = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.iser_target_prefix   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_host             = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_login            = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_mount_options    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_password         = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_private_key      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_share_path       = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_ssh_port         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.num_shell_tries      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.nvmet_port_id        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.replication_device   = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.report_discard_supported = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.reserved_percentage  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.scst_target_driver   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.storage_protocol     = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.target_helper        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.target_ip_address    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.target_port          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.target_prefix        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.target_protocol      = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.trace_flags          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.use_chap_auth        = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_clear         = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_clear_size    = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] QuobyteHD.volumes_dir          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.ssl      = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_notifications.driver = [] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_notifications.retry = -1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] oslo_messaging_notifications.transport_url = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] key_manager.fixed_key          = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.barbican_api_version  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.barbican_endpoint     = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.barbican_endpoint_type = public {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.barbican_region_name  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.cafile                = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.certfile              = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.collect_timing        = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.insecure              = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.keyfile               = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.number_of_retries     = 60 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.retry_delay           = 1 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.send_service_user_token = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.split_loggers         = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.timeout               = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.tls_ciphers           = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.tls_min_version       = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.verify_ssl            = True {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican.verify_ssl_path       = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.auth_section = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.auth_type = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.cafile   = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.certfile = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.collect_timing = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.insecure = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.keyfile  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.split_loggers = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.timeout  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.tls_ciphers = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] barbican_service_user.tls_min_version = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.approle_role_id          = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.approle_secret_id        = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.auth_method              = approle {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.auth_path                = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.kv_mountpoint            = secret {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.kv_path                  = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.kv_version               = 2 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.namespace                = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.root_token_id            = **** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.ssl_ca_crt_file          = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.timeout                  = 60.0 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.token_file               = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.token_role               = None {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.use_ssl                  = False {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:25 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] ******************************************************************************** {{(pid=87298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 11 06:13:26 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.388s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:26 devstack cinder-volume[87515]: INFO cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 succeeded
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.399s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:26 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:13:26 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:26 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.244s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:26 devstack cinder-volume[87515]: INFO cinder.volume.driver [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Driver hasn't implemented _init_vendor_properties()
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.volume.driver [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.230613708496, 'free_capacity_gb': 1773.230613708496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87515) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_db.sqlalchemy.engines [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG dbcounter [-] [87515] Writer thread running {{(pid=87515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.db.api [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Building query based on filter {{(pid=87515) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.image.image_utils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87515) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 11 06:13:26 devstack cinder-volume[87515]: INFO cinder.keymgr.migration [None req-029abf21-2f63-4dba-ab94-e8338d53a065 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:26 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:13:26 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:26 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.243s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.manager [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Notifying Schedulers of capabilities ... {{(pid=87515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:13:26 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Driver initialization completed successfully.
Sep 11 06:13:26 devstack cinder-volume[87515]: INFO cinder.manager [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Initiating service 3 cleanup
Sep 11 06:13:26 devstack cinder-volume[87515]: INFO cinder.manager [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Service 3 cleanup completed.
Sep 11 06:13:26 devstack cinder-volume[87515]: DEBUG cinder.service [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Creating RPC server for service cinder-volume {{(pid=87515) start /opt/stack/cinder/cinder/service.py:231}}
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG cinder.service [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87515) start /opt/stack/cinder/cinder/service.py:237}}
Sep 11 06:13:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=87515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG cinder.volume.drivers.quobyte [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=87515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:27 devstack sudo[87598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:13:27 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:27 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:27 devstack cinder-volume[87515]: DEBUG oslo_concurrency.processutils [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.267s {{(pid=87515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:27 devstack cinder-volume[87515]: INFO cinder.volume.manager [None req-e485755d-158e-4771-9882-6f4bdd31c8d2 None None] Driver post RPC initialization completed successfully.
Sep 11 06:13:31 devstack cinder-volume[87298]: INFO oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Caught SIGTERM, stopping children
Sep 11 06:13:31 devstack cinder-volume[87298]: DEBUG oslo_concurrency.lockutils [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Acquiring lock "singleton_lock" {{(pid=87298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 06:13:31 devstack cinder-volume[87298]: DEBUG oslo_concurrency.lockutils [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Acquired lock "singleton_lock" {{(pid=87298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 06:13:31 devstack cinder-volume[87298]: DEBUG oslo_concurrency.lockutils [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Releasing lock "singleton_lock" {{(pid=87298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 06:13:31 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Stop services. {{(pid=87298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 11 06:13:31 devstack cinder-volume[87298]: DEBUG oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Killing children. {{(pid=87298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 11 06:13:31 devstack cinder-volume[87298]: INFO oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Waiting on 1 children to exit
Sep 11 06:13:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Acquiring lock "singleton_lock" {{(pid=87515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 06:13:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Acquired lock "singleton_lock" {{(pid=87515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 06:13:35 devstack cinder-volume[87515]: DEBUG oslo_concurrency.lockutils [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Releasing lock "singleton_lock" {{(pid=87515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 06:13:35 devstack cinder-volume[87515]: WARNING amqp [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 06:13:35 devstack cinder-volume[87515]: WARNING amqp [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 06:13:35 devstack cinder-volume[87298]: INFO oslo_service.backend._eventlet.service [None req-9bd27464-602e-4582-bf13-f8a9f2f9a4cd None None] Child 87515 exited with status 0
Sep 11 06:13:36 devstack cinder-volume[87801]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 11 06:13:36 devstack cinder-volume[87801]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 06:13:36 devstack cinder-volume[87801]: we strongly recommend against using it for new projects.
Sep 11 06:13:36 devstack cinder-volume[87801]: If you are already using Eventlet, we recommend migrating to a different
Sep 11 06:13:36 devstack cinder-volume[87801]: framework.  For more detail see
Sep 11 06:13:36 devstack cinder-volume[87801]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 06:13:36 devstack cinder-volume[87801]:   import eventlet  # noqa
Sep 11 06:13:38 devstack cinder-volume[87801]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 06:13:38 devstack cinder-volume[87801]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 06:13:38 devstack cinder-volume[87801]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 06:13:39 devstack cinder-volume[87801]: INFO dbcounter [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Registered counter for database cinder
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_db.sqlalchemy.engines [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG dbcounter [-] [87801] Writer thread running {{(pid=87801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 06:13:39 devstack cinder-volume[87801]: INFO cinder.rpc [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 11 06:13:39 devstack cinder-volume[87801]: INFO cinder.rpc [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_db.sqlalchemy.engines [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:39 devstack cinder-volume[87801]: INFO cinder.volume.manager [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Determined volume DB was empty at startup.
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG cinder.volume.manager [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87801) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 11 06:13:39 devstack cinder-volume[87801]: WARNING stevedore.named [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 06:13:39 devstack cinder-volume[87801]: WARNING castellan.key_manager [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 06:13:39 devstack cinder-volume[87801]: WARNING cinder.keymgr.conf_key_mgr [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 06:13:39 devstack cinder-volume[87801]: INFO cinder.volume.manager [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_db.sqlalchemy.engines [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:39 devstack cinder-volume[87801]: INFO oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Starting 1 workers
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Started child 88109 {{(pid=87801) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Full set of CONF: {{(pid=87801) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] ******************************************************************************** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] Configuration options gathered from: {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] ================================================================================ {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] allow_availability_zone_fallback = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] allow_compression_on_image_upload = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] allowed_direct_url_schemes     = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] api_rate_limit                 = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] auth_strategy                  = keystone {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_availability_zone      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_host                   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_name                   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_stats_polling_interval = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backup_api_class               = cinder.backup.api.API {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backup_name_template           = backup-%s {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[88109]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backup_use_same_host           = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backup_use_temp_snapshot       = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] chap_password                  = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] chap_username                  =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_internal_tenant_project_id = 32ea3bef8ac2445880d09ae0fd57c128 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_internal_tenant_user_id = f5362a8e85aa40a4bfb9945bef432bd8 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cluster                        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] compression_format             = gzip {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] compute_api_class              = cinder.compute.nova.API {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] config_dir                     = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] config_source                  = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] control_exchange               = openstack {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] debug                          = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] default_availability_zone      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] default_group_type             = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] default_volume_type            = QuobyteHD {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] disk_geometry                  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] driver_client_cert             = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] driver_client_cert_key         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] driver_data_namespace          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] driver_ssl_cert_path           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] driver_ssl_cert_verify         = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] driver_use_ssl                 = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] enable_new_services            = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] enable_unsupported_driver      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] enabled_backends               = ['QuobyteHD'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] enforce_multipath_for_image_xfer = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] filter_function                = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_api_insecure            = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_api_servers             = ['http://192.168.122.132/image'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_api_ssl_compression     = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_ca_certificates_file    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_catalog_info            = image:glance:publicURL {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_certfile                = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_keyfile                 = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_num_retries             = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance_request_timeout         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] goodness_function              = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] graceful_shutdown_timeout      = 5 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] group_api_class                = cinder.group.api.API {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] host                           = devstack {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_compress_on_upload       = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_conversion_address_space_limit = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_conversion_cpu_limit     = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_conversion_disable       = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_upload_use_cinder_backend = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_upload_use_internal_tenant = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_volume_cache_enabled     = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_volume_cache_max_count   = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] image_volume_cache_max_size_gb = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] init_host_max_objects_retrieval = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] instance_format                = [instance: %(uuid)s]  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] iscsi_target_flags             =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] iscsi_write_cache              = on {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] iser_helper                    = tgtadm {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] iser_ip_address                = 192.168.122.132 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] iser_port                      = 3260 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_color                      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_config_append              = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_dir                        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_file                       = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_options                    = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_rotate_interval            = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_rotate_interval_type       = days {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] log_rotation_type              = none {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] max_age                        = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] max_logfile_count              = 30 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] max_logfile_size_mb            = 200 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] max_over_subscription_ratio    = 20.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] message_reap_interval          = 86400 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] message_ttl                    = 2592000 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] migration_create_volume_timeout_secs = 300 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] monkey_patch                   = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] monkey_patch_modules           = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] my_ip                          = 192.168.122.132 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] no_snapshot_gb_quota           = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] num_iser_scan_tries            = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] num_shell_tries                = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] num_volume_device_scan_tries   = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] nvmeof_conn_info_version       = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] nvmet_ns_id                    = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] nvmet_port_id                  = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] osapi_max_limit                = 1000 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] osapi_volume_ext_list          = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] osapi_volume_listen_port       = 8776 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] osapi_volume_use_ssl           = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] osapi_volume_workers           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] per_volume_size_limit          = -1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] periodic_fuzzy_delay           = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] periodic_interval              = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] public_endpoint                = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] publish_errors                 = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] quota_backup_gigabytes         = 1000 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] quota_backups                  = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] quota_gigabytes                = 1000 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] quota_groups                   = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] quota_snapshots                = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] quota_volumes                  = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] rate_limit_burst               = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] rate_limit_except_level        = CRITICAL {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] rate_limit_interval            = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] reinit_driver_count            = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] replication_device             = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] report_discard_supported       = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] report_interval                = 120 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] reservation_clean_interval     = 86400 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] reservation_expire             = 86400 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] reserved_image_namespaces      = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] reserved_percentage            = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] rpc_response_timeout           = 120 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] run_external_periodic_tasks    = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] scst_target_driver             = iscsi {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] scst_target_iqn_name           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_down_time              = 720 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] shell_completion               = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] snapshot_name_template         = snapshot-%s {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] split_loggers                  = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] state_path                     = /opt/stack/data/cinder {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] storage_availability_zone      = nova {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] storage_protocol               = iSCSI {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] syslog_log_facility            = LOG_USER {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] target_helper                  = lioadm {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] target_ip_address              = 192.168.122.132 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] target_port                    = 3260 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] target_protocol                = iscsi {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] target_secondary_ip_addresses  = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] trace_flags                    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] transport_url                  = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] until_refresh                  = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] use_chap_auth                  = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] use_default_quota_class        = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] use_journal                    = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] use_json                       = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] use_multipath_for_image_xfer   = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] use_stderr                     = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] use_syslog                     = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] verify_glance_signatures       = enabled {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_api_class               = cinder.volume.api.API {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_backend_name            = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_clear                   = zero {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_clear_ionice            = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_clear_size              = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_copy_bps_limit          = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_dd_blocksize            = 1M {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_name_template           = volume-%s {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_service_inithost_offload = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88109) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volume_usage_audit_period      = month {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] zoning_mode                    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_concurrency.disable_process_locking = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.auth_section = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.auth_type   = password {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.auth_version = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.cache       = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.certfile    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.include_service_catalog = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.insecure    = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.interface   = public {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.keyfile     = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_password = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcache_username = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.region_name = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.service_type = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.backend                  = dogpile.cache.null {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.backend_argument         = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.backend_expiration_time  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.config_prefix            = cache.oslo {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.debug_cache_backend      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.enable_retry_client      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.enable_socket_keepalive  = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.enabled                  = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.expiration_time          = 600 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.hashclient_retry_attempts = 2 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.memcache_dead_retry      = 300 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.memcache_pool_maxsize    = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.memcache_sasl_enabled    = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.password                 = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.proxies                  = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.redis_db                 = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.redis_server             = localhost:6379 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.retry_attempts           = 2 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.retry_delay              = 0.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.socket_keepalive_count   = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.socket_keepalive_idle    = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.socket_keepalive_interval = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.socket_timeout           = 1.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.tls_allowed_ciphers      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.tls_cafile               = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.tls_certfile             = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.tls_enabled              = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.tls_keyfile              = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cache.username                 = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] coordination.backend_url       = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.asyncio_connection    = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.asyncio_slave_connection = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.backend               = sqlalchemy {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.connection            = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.connection_debug      = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.connection_parameters =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.connection_recycle_time = 3600 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.connection_trace      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.db_inc_retry_interval = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.db_max_retries        = 20 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.db_max_retry_interval = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.db_retry_interval     = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.max_overflow          = 50 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.max_pool_size         = 5 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.max_retries           = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.mysql_wsrep_sync_wait = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.pool_timeout          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.retry_interval        = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.slave_connection      = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.sqlite_synchronous    = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.synchronous_reader    = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] database.use_db_reconnect      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_tracing.insecure = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.connection_string     = messaging:// {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.enabled               = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.es_doc_type           = notification {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.es_scroll_size        = 10000 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.es_scroll_time        = 2m {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.filter_error_trace    = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.hmac_keys             = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.sentinel_service_name = mymaster {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.socket_timeout        = 0.1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.trace_requests        = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler.trace_sqlalchemy      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler_jaeger.process_tags   = {} {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler_jaeger.service_name_prefix = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] profiler_otlp.service_name_prefix = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.enforce_new_defaults = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.policy_default_rule = default {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.policy_file        = policy.yaml {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] privsep_osbrick.group          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] privsep_osbrick.helper_command = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] privsep_osbrick.user           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_sys_admin.group         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_sys_admin.helper_command = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] cinder_sys_admin.user          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:39 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.auth_section      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.auth_type         = password {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.cafile            = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.certfile          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.collect_timing    = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.insecure          = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.keyfile           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.send_service_user_token = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.split_loggers     = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.timeout           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.tls_ciphers       = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] service_user.tls_min_version   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.auth_section            = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.auth_type               = password {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.certfile                = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.collect_timing          = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.insecure                = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.keyfile                 = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.region_name             = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.split_loggers           = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.timeout                 = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.tls_ciphers             = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] glance.tls_min_version         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.backend_availability_zone = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.chap_password = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.chap_username =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.disk_geometry = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.driver_client_cert = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.driver_client_cert_key = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.driver_data_namespace = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88109) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.driver_use_ssl = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.extra_capabilities = {} {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.filter_function = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.goodness_function = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.iscsi_target_flags =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.iscsi_write_cache = on {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.iser_helper   = tgtadm {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.iser_port     = 3260 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_host      =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Running cmd (subprocess): mount.quobyte {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_login     = admin {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_mount_options = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_password  = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_private_key =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_share_path =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.num_shell_tries = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.quobyte_volume_url = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.replication_device = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.report_discard_supported = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.reserved_percentage = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.target_helper = tgtadm {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.target_port   = 3260 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.target_protocol = iscsi {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.trace_flags   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.unique_fqdn_network = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.use_chap_auth = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_backend_name = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_clear  = zero {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_clear_ionice = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_clear_size = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_reports.file_event_handler = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_reports.log_dir           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.backend_availability_zone = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.backend_host         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.chap_password        = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.chap_username        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.chiscsi_conf         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.disk_geometry        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.driver_client_cert   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.driver_data_namespace = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.driver_use_ssl       = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.extra_capabilities   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.filter_function      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.goodness_function    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.iser_helper          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.iser_ip_address      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.iser_port            = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.iser_target_prefix   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_host             = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_login            = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_mount_options    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_password         = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_private_key      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_share_path       = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_ssh_port         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.num_shell_tries      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.nvmet_port_id        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.replication_device   = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.report_discard_supported = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.reserved_percentage  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.scst_target_driver   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.storage_protocol     = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.target_helper        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.target_ip_address    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.target_port          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.target_prefix        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.target_protocol      = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.trace_flags          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.use_chap_auth        = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_clear         = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_clear_size    = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] QuobyteHD.volumes_dir          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.ssl      = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_notifications.driver = [] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_notifications.retry = -1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] key_manager.fixed_key          = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.barbican_api_version  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.barbican_endpoint     = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.barbican_endpoint_type = public {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.barbican_region_name  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack quobyte-client[88110]: Reading configuration file: /etc/quobyte/client.cfg
Sep 11 06:13:40 devstack quobyte-client[88110]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.cafile                = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.certfile              = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.collect_timing        = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.insecure              = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.keyfile               = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.number_of_retries     = 60 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.retry_delay           = 1 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.send_service_user_token = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.split_loggers         = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.timeout               = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.tls_ciphers           = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.tls_min_version       = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.verify_ssl            = True {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican.verify_ssl_path       = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.auth_section = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.auth_type = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.cafile   = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.certfile = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.collect_timing = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.insecure = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.keyfile  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.split_loggers = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.timeout  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.tls_ciphers = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] barbican_service_user.tls_min_version = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.approle_role_id          = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.approle_secret_id        = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.auth_method              = approle {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.auth_path                = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.kv_mountpoint            = secret {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.kv_path                  = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.kv_version               = 2 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.namespace                = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.root_token_id            = **** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.ssl_ca_crt_file          = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.timeout                  = 60.0 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.token_file               = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.token_role               = None {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.use_ssl                  = False {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 06:13:40 devstack cinder-volume[87801]: DEBUG oslo_service.backend._eventlet.service [None req-93e636a9-8e07-443b-aced-7e554bad944e None None] ******************************************************************************** {{(pid=87801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 11 06:13:40 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:13:40 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:40 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.230s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:40 devstack cinder-volume[88109]: INFO cinder.volume.driver [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Driver hasn't implemented _init_vendor_properties()
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.driver [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.230613708496, 'free_capacity_gb': 1773.230613708496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88109) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_db.sqlalchemy.engines [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writer thread running {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.db.api [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Building query based on filter {{(pid=88109) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88109) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:40 devstack cinder-volume[88109]: INFO cinder.keymgr.migration [None req-643d1604-6a6a-491a-b8af-5ae455987447 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 11 06:13:40 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:13:40 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:40 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.238s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:13:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Driver initialization completed successfully.
Sep 11 06:13:40 devstack cinder-volume[88109]: INFO cinder.manager [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Initiating service 3 cleanup
Sep 11 06:13:40 devstack cinder-volume[88109]: INFO cinder.manager [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Service 3 cleanup completed.
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.service [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Creating RPC server for service cinder-volume {{(pid=88109) start /opt/stack/cinder/cinder/service.py:231}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.service [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88109) start /opt/stack/cinder/cinder/service.py:237}}
Sep 11 06:13:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:13:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:13:40 devstack sudo[88133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:13:40 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:13:41 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root
Sep 11 06:13:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.234s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:13:41 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-215063d3-05f6-424d-8d86-08f0dd328c7f None None] Driver post RPC initialization completed successfully.
Sep 11 06:13:49 devstack cinder-volume[87801]: DEBUG dbcounter [-] [87801] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:13:50 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=2 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:13:51 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:14:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:14:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 6 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:14:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Flow 'volume_create_manager' (c9a052f5-248d-45e7-8d41-bfa667925a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747debff-c54f-463e-b8d3-5d1ec4e8de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747debff-c54f-463e-b8d3-5d1ec4e8de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-661273698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc70fa2-3741-4c39-8c34-7fc0358248a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16378f092fe74558b77a6c1d14a992ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:14:37Z,use_quota=True,user_id='e2d9e0df56424710afcec86d0895441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b10934-9d95-483a-84bc-cf026dc888fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b10934-9d95-483a-84bc-cf026dc888fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69951b4-cd72-4011-91ee-5c6bcdfd09ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69951b4-cd72-4011-91ee-5c6bcdfd09ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc70fa2-3741-4c39-8c34-7fc0358248a1', 'volume_name': 'volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1c0620-ea66-473d-909d-9d11c2a1d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1c0620-ea66-473d-909d-9d11c2a1d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8996d2-efa3-4f3d-8d77-3920b0ce0f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:14:37 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Volume 4dc70fa2-3741-4c39-8c34-7fc0358248a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1', 'volume_size': 1}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-661273698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc70fa2-3741-4c39-8c34-7fc0358248a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16378f092fe74558b77a6c1d14a992ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:14:37Z,use_quota=True,user_id='e2d9e0df56424710afcec86d0895441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Creating volume 4dc70fa2-3741-4c39-8c34-7fc0358248a1 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:14:37 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:14:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:14:37 devstack sudo[88421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1 1073741824
Sep 11 06:14:37 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:14:38 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1 1073741824" returned: 0 in 0.853s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:14:38 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1
Sep 11 06:14:38 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:14:38 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1" returned: 0 in 0.310s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8996d2-efa3-4f3d-8d77-3920b0ce0f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec313fa-01dc-4654-9805-581353ce712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:14:38 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Volume volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1 (4dc70fa2-3741-4c39-8c34-7fc0358248a1): created successfully
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec313fa-01dc-4654-9805-581353ce712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:14:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Flow 'volume_create_manager' (c9a052f5-248d-45e7-8d41-bfa667925a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:14:38 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0a625811-a359-4249-bfb3-7f3df41fc385 tempest-TaggedAttachmentsTest-290365075 None] Created volume successfully.
Sep 11 06:14:48 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:14:48 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Flow 'volume_create_manager' (3058491a-ce52-4536-954e-ddecf1c11463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df79758c-b1ff-49d6-afa5-b774e792cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df79758c-b1ff-49d6-afa5-b774e792cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-197175292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950f73f0-726f-4a2c-a059-89ffdd8098f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ec2a1b42ff4ecdbb7ed5a9a426b1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:15:07Z,use_quota=True,user_id='d635d9b8bf9a435a945efbf48b9ab0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486473f1-3321-4ac0-9d79-67a71d443e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486473f1-3321-4ac0-9d79-67a71d443e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bd26c9-e143-41a4-a868-522b91ba33f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bd26c9-e143-41a4-a868-522b91ba33f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950f73f0-726f-4a2c-a059-89ffdd8098f8', 'volume_name': 'volume-950f73f0-726f-4a2c-a059-89ffdd8098f8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36a572b-09dd-4c76-9007-498cf66d6f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36a572b-09dd-4c76-9007-498cf66d6f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddec675-7f68-478a-b9bc-752ffdb1c222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:07 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Volume 950f73f0-726f-4a2c-a059-89ffdd8098f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950f73f0-726f-4a2c-a059-89ffdd8098f8', 'volume_size': 1}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-197175292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950f73f0-726f-4a2c-a059-89ffdd8098f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ec2a1b42ff4ecdbb7ed5a9a426b1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:15:07Z,use_quota=True,user_id='d635d9b8bf9a435a945efbf48b9ab0bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Creating volume 950f73f0-726f-4a2c-a059-89ffdd8098f8 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:15:07 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:15:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:07 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8 1073741824
Sep 11 06:15:07 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:08 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8 1073741824" returned: 0 in 0.629s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:08 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8
Sep 11 06:15:08 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:08 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8" returned: 0 in 0.542s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddec675-7f68-478a-b9bc-752ffdb1c222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950f73f0-726f-4a2c-a059-89ffdd8098f8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb01444-d26d-46d7-9d07-50f88d213a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Volume volume-950f73f0-726f-4a2c-a059-89ffdd8098f8 (950f73f0-726f-4a2c-a059-89ffdd8098f8): created successfully
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb01444-d26d-46d7-9d07-50f88d213a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Flow 'volume_create_manager' (3058491a-ce52-4536-954e-ddecf1c11463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:15:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b7604d9e-0f97-484a-84b4-e0f84230531d tempest-VolumesAdminNegativeTest-751694987 None] Created volume successfully.
Sep 11 06:15:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Acquiring lock "cinder-950f73f0-726f-4a2c-a059-89ffdd8098f8-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:15:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Lock "cinder-950f73f0-726f-4a2c-a059-89ffdd8098f8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:15:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Acquiring lock "cinder-quobyte-950f73f0-726f-4a2c-a059-89ffdd8098f8" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:15:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Lock "cinder-quobyte-950f73f0-726f-4a2c-a059-89ffdd8098f8" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:15:10 devstack cinder-volume[88109]: INFO oslo.privsep.daemon [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp__m8b2fc/privsep.sock']
Sep 11 06:15:10 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp__m8b2fc/privsep.sock
Sep 11 06:15:10 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 11 06:15:12 devstack cinder-volume[88109]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 11 06:15:13 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:13 devstack cinder-volume[88109]: INFO oslo.privsep.daemon [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Spawned new privsep daemon via rootwrap
Sep 11 06:15:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Accepted privsep connection to /tmp/tmp__m8b2fc/privsep.sock {{(pid=88109) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 11 06:15:13 devstack cinder-volume[88109]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 11 06:15:13 devstack cinder-volume[88109]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 11 06:15:13 devstack cinder-volume[88109]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 11 06:15:13 devstack cinder-volume[88109]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89230
Sep 11 06:15:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[445d466c-2b85-4171-b170-f69fc5d0b72b]: (2,) {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:15:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9681ae3a-9e11-4a36-864f-2272e966d8ff]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:15:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:13 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8
Sep 11 06:15:13 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:13 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8" returned: 0 in 0.549s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:13 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8
Sep 11 06:15:13 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:14 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-950f73f0-726f-4a2c-a059-89ffdd8098f8" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Lock "cinder-quobyte-950f73f0-726f-4a2c-a059-89ffdd8098f8" released by "delete_volume" :: held 3.424s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:15:14 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:15:14 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Created reservations ['460bb95d-6995-4fcf-8fa4-3798aeffcd8a', '124fa83e-8197-4769-9b9c-5f478c6dd4dc', 'd3a76eda-2245-424c-a7b3-4ba1e3068321', '09cb4349-82d7-49fe-9151-94b89dce26a1'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:14 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:15:14 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:14 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.339s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:15:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Deleted volume successfully.
Sep 11 06:15:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7b4cde26-f499-4692-9c3c-2861d6968c57 tempest-VolumesAdminNegativeTest-751694987 None] Lock "cinder-950f73f0-726f-4a2c-a059-89ffdd8098f8-delete_volume" released by "delete_volume" :: held 4.146s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:15:24 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:15:24 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Flow 'volume_create_manager' (c8490d0b-1be2-4349-9b24-84e7e8a15e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db56354-b8c6-4b59-a603-06d208d63a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db56354-b8c6-4b59-a603-06d208d63a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-385174274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd97be01-f72b-49b2-803a-9a69d712cd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba6143320224d7ea80853646fce378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:15:30Z,use_quota=True,user_id='6bb49f7a0da044a4b95fae8cdb5b2566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9624e964-284f-4f60-b9dc-7b9bc885b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9624e964-284f-4f60-b9dc-7b9bc885b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e39281-f6dc-4bc8-8be7-37c0fe0200f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e39281-f6dc-4bc8-8be7-37c0fe0200f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd97be01-f72b-49b2-803a-9a69d712cd1b', 'volume_name': 'volume-cd97be01-f72b-49b2-803a-9a69d712cd1b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6721e9-a556-40b1-a819-94b04a22459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6721e9-a556-40b1-a819-94b04a22459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d909c856-a1db-41ea-807e-ae63d788f34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:29 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Volume cd97be01-f72b-49b2-803a-9a69d712cd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd97be01-f72b-49b2-803a-9a69d712cd1b', 'volume_size': 1}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-385174274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd97be01-f72b-49b2-803a-9a69d712cd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba6143320224d7ea80853646fce378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:15:30Z,use_quota=True,user_id='6bb49f7a0da044a4b95fae8cdb5b2566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Creating volume cd97be01-f72b-49b2-803a-9a69d712cd1b {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:15:29 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:15:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:30 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b 1073741824
Sep 11 06:15:30 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:30 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b 1073741824" returned: 0 in 0.513s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:30 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b
Sep 11 06:15:30 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:30 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b" returned: 0 in 0.329s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d909c856-a1db-41ea-807e-ae63d788f34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd97be01-f72b-49b2-803a-9a69d712cd1b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e67f346-36ba-4abc-8474-b36e25929343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:15:30 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Volume volume-cd97be01-f72b-49b2-803a-9a69d712cd1b (cd97be01-f72b-49b2-803a-9a69d712cd1b): created successfully
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e67f346-36ba-4abc-8474-b36e25929343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:15:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Flow 'volume_create_manager' (c8490d0b-1be2-4349-9b24-84e7e8a15e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:15:30 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0cd46062-ddad-4f1c-9356-6e9849e170a9 tempest-AttachVolumeTestJSON-2000479679 None] Created volume successfully.
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:15:31 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:15:31 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:15:31 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.266s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 8 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:15:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:15:34 devstack cinder-volume[88109]: WARNING py.warnings [req-fd53e8e3-8ee6-4d3b-947c-97c37f6c5208 req-67ae7271-e56e-4159-9636-3651f6eb0274 tempest-AttachVolumeTestJSON-2000479679 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 11 06:15:34 devstack cinder-volume[88109]:   .first()
Sep 11 06:15:34 devstack cinder-volume[88109]: 
Sep 11 06:15:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-fd53e8e3-8ee6-4d3b-947c-97c37f6c5208 req-67ae7271-e56e-4159-9636-3651f6eb0274 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-fd53e8e3-8ee6-4d3b-947c-97c37f6c5208 req-67ae7271-e56e-4159-9636-3651f6eb0274 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-fd53e8e3-8ee6-4d3b-947c-97c37f6c5208 req-67ae7271-e56e-4159-9636-3651f6eb0274 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-fd53e8e3-8ee6-4d3b-947c-97c37f6c5208 req-67ae7271-e56e-4159-9636-3651f6eb0274 tempest-AttachVolumeTestJSON-2000479679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-cd97be01-f72b-49b2-803a-9a69d712cd1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f947dfc-0b85-4490-988c-7c0c44e1c6b4', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:15:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-fd53e8e3-8ee6-4d3b-947c-97c37f6c5208 req-67ae7271-e56e-4159-9636-3651f6eb0274 tempest-AttachVolumeTestJSON-2000479679 None] attachment_update completed successfully.
Sep 11 06:15:45 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:15:51 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:15:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-982bd7d3-1abc-4e14-b522-6d705c4bf118 req-ae282a34-b034-4a85-8063-b4a25418ef66 tempest-TaggedAttachmentsTest-290365075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:15:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-982bd7d3-1abc-4e14-b522-6d705c4bf118 req-ae282a34-b034-4a85-8063-b4a25418ef66 tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:15:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-982bd7d3-1abc-4e14-b522-6d705c4bf118 req-ae282a34-b034-4a85-8063-b4a25418ef66 tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:15:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-982bd7d3-1abc-4e14-b522-6d705c4bf118 req-ae282a34-b034-4a85-8063-b4a25418ef66 tempest-TaggedAttachmentsTest-290365075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3a16c6e-9091-4cbb-b130-3a3c9e2cc58a', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:15:59 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-982bd7d3-1abc-4e14-b522-6d705c4bf118 req-ae282a34-b034-4a85-8063-b4a25418ef66 tempest-TaggedAttachmentsTest-290365075 None] attachment_update completed successfully.
Sep 11 06:16:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-40f10394-8054-4bf4-8c2f-50edd58dccd2 req-6a24a97f-6acf-4991-8b12-55edf20ef703 tempest-TaggedAttachmentsTest-290365075 None] Terminate volume connection completed successfully.
Sep 11 06:16:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-40f10394-8054-4bf4-8c2f-50edd58dccd2 req-6a24a97f-6acf-4991-8b12-55edf20ef703 tempest-TaggedAttachmentsTest-290365075 None] Deleting attachment d3a16c6e-9091-4cbb-b130-3a3c9e2cc58a. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Flow 'volume_create_manager' (4105f840-a715-42fd-b9d5-ed276bcb27cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1905335c-2f79-4d1b-bd00-8b3060cb521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1905335c-2f79-4d1b-bd00-8b3060cb521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1547687761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24bc01d-f6d9-40b2-84ea-071d17556bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60beaa9cd0f34292987a53d8003ad394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:16:09Z,use_quota=True,user_id='8e4067c466d348b8acedd61cb4d665d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b5966c-33ac-44af-8a34-0f7d775e3d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b5966c-33ac-44af-8a34-0f7d775e3d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deb35bb-d8ce-48ff-a020-bd06518d5eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deb35bb-d8ce-48ff-a020-bd06518d5eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24bc01d-f6d9-40b2-84ea-071d17556bb7', 'volume_name': 'volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54870f00-9880-41d4-a91d-aef33c0665d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54870f00-9880-41d4-a91d-aef33c0665d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5efc537-8987-48d4-8d07-ce3c94ec53a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Volume c24bc01d-f6d9-40b2-84ea-071d17556bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7', 'volume_size': 1}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1547687761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24bc01d-f6d9-40b2-84ea-071d17556bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60beaa9cd0f34292987a53d8003ad394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:16:09Z,use_quota=True,user_id='8e4067c466d348b8acedd61cb4d665d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Creating volume c24bc01d-f6d9-40b2-84ea-071d17556bb7 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:16:08 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:16:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:08 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7 1073741824
Sep 11 06:16:08 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:10 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7 1073741824" returned: 0 in 1.118s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:10 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:16:10 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Flow 'volume_create_manager' (63756400-3c69-40f1-b0f9-0f79e375278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db66c4e6-fe0d-4239-bfb6-77ebfda717ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db66c4e6-fe0d-4239-bfb6-77ebfda717ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-134122136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a117ca-9357-410c-93ff-905f2d60752b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d66bf0e444cffa5e57dd800a2fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:16:10Z,use_quota=True,user_id='b7583879a5f2418ebcb0564dfcc047ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb206520-5632-4ac4-8687-bbc188322264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb206520-5632-4ac4-8687-bbc188322264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19ef01b-e94a-4a3a-a0b2-1ffd65c5c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19ef01b-e94a-4a3a-a0b2-1ffd65c5c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a117ca-9357-410c-93ff-905f2d60752b', 'volume_name': 'volume-f1a117ca-9357-410c-93ff-905f2d60752b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d80c71-8f87-4b5e-8c17-29dfd7a1c87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d80c71-8f87-4b5e-8c17-29dfd7a1c87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f81d918-6502-4a37-af7b-fa0673aebc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Volume f1a117ca-9357-410c-93ff-905f2d60752b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a117ca-9357-410c-93ff-905f2d60752b', 'volume_size': 1}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-c64a419c-7906-4353-8f69-c96f979e1686 req-d7e5cf77-5dee-4898-a16c-d68051dccdbf tempest-AttachVolumeTestJSON-2000479679 None] Terminate volume connection completed successfully.
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-c64a419c-7906-4353-8f69-c96f979e1686 req-d7e5cf77-5dee-4898-a16c-d68051dccdbf tempest-AttachVolumeTestJSON-2000479679 None] Deleting attachment 5f947dfc-0b85-4490-988c-7c0c44e1c6b4. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:16:10 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7" returned: 0 in 0.478s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-134122136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a117ca-9357-410c-93ff-905f2d60752b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d66bf0e444cffa5e57dd800a2fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:16:10Z,use_quota=True,user_id='b7583879a5f2418ebcb0564dfcc047ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Creating volume f1a117ca-9357-410c-93ff-905f2d60752b {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:16:10 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5efc537-8987-48d4-8d07-ce3c94ec53a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:10 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b 1073741824
Sep 11 06:16:10 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3ddf04-e731-4f6d-b76c-9c01155b38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Volume volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7 (c24bc01d-f6d9-40b2-84ea-071d17556bb7): created successfully
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3ddf04-e731-4f6d-b76c-9c01155b38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Flow 'volume_create_manager' (4105f840-a715-42fd-b9d5-ed276bcb27cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:16:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a87a1eb0-634a-4c93-9da3-ac89d102bac0 tempest-DeleteServersTestJSON-891134107 None] Created volume successfully.
Sep 11 06:16:11 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b 1073741824" returned: 0 in 1.269s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:12 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b
Sep 11 06:16:12 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:12 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b" returned: 0 in 0.380s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f81d918-6502-4a37-af7b-fa0673aebc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a117ca-9357-410c-93ff-905f2d60752b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29914b19-44cc-4c08-b165-7d0a658df56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:16:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Volume volume-f1a117ca-9357-410c-93ff-905f2d60752b (f1a117ca-9357-410c-93ff-905f2d60752b): created successfully
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29914b19-44cc-4c08-b165-7d0a658df56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Flow 'volume_create_manager' (63756400-3c69-40f1-b0f9-0f79e375278c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:16:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-855c9de4-f5c8-47eb-9bf5-048d16b9bafb tempest-ServerActionsTestOtherA-293895743 None] Created volume successfully.
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-71d14bca-7dac-49bc-818a-edc98103b9df req-9a9e8064-5c07-4524-a2d2-1287bf391501 tempest-DeleteServersTestJSON-891134107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-71d14bca-7dac-49bc-818a-edc98103b9df req-9a9e8064-5c07-4524-a2d2-1287bf391501 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-71d14bca-7dac-49bc-818a-edc98103b9df req-9a9e8064-5c07-4524-a2d2-1287bf391501 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-71d14bca-7dac-49bc-818a-edc98103b9df req-9a9e8064-5c07-4524-a2d2-1287bf391501 tempest-DeleteServersTestJSON-891134107 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af000fcb-5b0e-486e-b4e5-a4233283aa8d', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:16:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-71d14bca-7dac-49bc-818a-edc98103b9df req-9a9e8064-5c07-4524-a2d2-1287bf391501 tempest-DeleteServersTestJSON-891134107 None] attachment_update completed successfully.
Sep 11 06:16:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-bc601b02-25ff-44e3-969a-a375d1a75993 req-e41f6024-c03d-4295-a3f3-e898d0a0ae66 tempest-DeleteServersTestJSON-891134107 None] Terminate volume connection completed successfully.
Sep 11 06:16:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-bc601b02-25ff-44e3-969a-a375d1a75993 req-e41f6024-c03d-4295-a3f3-e898d0a0ae66 tempest-DeleteServersTestJSON-891134107 None] Deleting attachment af000fcb-5b0e-486e-b4e5-a4233283aa8d. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Acquiring lock "cinder-4dc70fa2-3741-4c39-8c34-7fc0358248a1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Lock "cinder-4dc70fa2-3741-4c39-8c34-7fc0358248a1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Acquiring lock "cinder-quobyte-4dc70fa2-3741-4c39-8c34-7fc0358248a1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Lock "cinder-quobyte-4dc70fa2-3741-4c39-8c34-7fc0358248a1" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa08939-f88e-49ab-851f-673184d0242d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:19 devstack sudo[91315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1
Sep 11 06:16:19 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:19 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1" returned: 0 in 0.534s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:19 devstack sudo[91322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1
Sep 11 06:16:19 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:20 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4dc70fa2-3741-4c39-8c34-7fc0358248a1" returned: 0 in 0.684s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Lock "cinder-quobyte-4dc70fa2-3741-4c39-8c34-7fc0358248a1" released by "delete_volume" :: held 1.274s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Created reservations ['73231bce-4efc-4da6-b960-ec1daea2f48f', '70722701-068f-44ea-9bad-24a10c800f88', 'be657082-47e4-4b6f-af64-2d89ef4f6d48', '03eb9000-d056-479d-bf03-122e8fe2685f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:20 devstack sudo[91337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:16:20 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:20 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:20 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:16:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Deleted volume successfully.
Sep 11 06:16:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1fe3275-9c17-481e-8014-4a1b1eccdb1a tempest-TaggedAttachmentsTest-290365075 None] Lock "cinder-4dc70fa2-3741-4c39-8c34-7fc0358248a1-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:16:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Acquiring lock "cinder-c24bc01d-f6d9-40b2-84ea-071d17556bb7-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:16:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Lock "cinder-c24bc01d-f6d9-40b2-84ea-071d17556bb7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:16:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Acquiring lock "cinder-quobyte-c24bc01d-f6d9-40b2-84ea-071d17556bb7" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:16:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Lock "cinder-quobyte-c24bc01d-f6d9-40b2-84ea-071d17556bb7" acquired by "delete_volume" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:16:21 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1564f840-d259-4d88-b3a2-4f6cc16a722d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:16:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:22 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7
Sep 11 06:16:22 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:22 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7" returned: 0 in 0.596s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:22 devstack sudo[91351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7
Sep 11 06:16:22 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:22 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c24bc01d-f6d9-40b2-84ea-071d17556bb7" returned: 0 in 0.371s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Lock "cinder-quobyte-c24bc01d-f6d9-40b2-84ea-071d17556bb7" released by "delete_volume" :: held 1.029s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:16:22 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Created reservations ['653af011-2b46-454b-be93-80804c042f04', '3796f292-5d1a-4dc8-858c-98a261da740e', '5b6e5a00-082c-4b2b-8c0b-048e10a846f2', 'a6cb8f47-15aa-4ec4-860b-2b9fd6256fd8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:23 devstack sudo[91367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:16:23 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:23 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.604s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:16:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Deleted volume successfully.
Sep 11 06:16:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e89a9249-3c68-436b-a6e6-ed8f41c37b28 tempest-DeleteServersTestJSON-891134107 None] Lock "cinder-c24bc01d-f6d9-40b2-84ea-071d17556bb7-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:16:31 devstack sudo[91410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:16:31 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:16:31 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.640s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:16:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:16:33 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=31,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:16:33 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=29,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=3 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:16:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-cd54aa6a-b5fb-443f-8619-a9c0672ad81e req-bad2e4ea-1396-44ef-968e-4389835013c2 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:16:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-cd54aa6a-b5fb-443f-8619-a9c0672ad81e req-bad2e4ea-1396-44ef-968e-4389835013c2 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:16:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-cd54aa6a-b5fb-443f-8619-a9c0672ad81e req-bad2e4ea-1396-44ef-968e-4389835013c2 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:16:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-cd54aa6a-b5fb-443f-8619-a9c0672ad81e req-bad2e4ea-1396-44ef-968e-4389835013c2 tempest-ServerActionsTestOtherA-293895743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-f1a117ca-9357-410c-93ff-905f2d60752b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66e7835b-9205-4ad1-90aa-6fccc75ef7a6', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:16:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-cd54aa6a-b5fb-443f-8619-a9c0672ad81e req-bad2e4ea-1396-44ef-968e-4389835013c2 tempest-ServerActionsTestOtherA-293895743 None] attachment_update completed successfully.
Sep 11 06:17:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-e999768d-220e-480f-89b5-13db400bd3f8 req-99e9b142-4695-41e9-bb35-f3d7181c8c74 tempest-ServerActionsTestOtherA-293895743 None] Terminate volume connection completed successfully.
Sep 11 06:17:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-e999768d-220e-480f-89b5-13db400bd3f8 req-99e9b142-4695-41e9-bb35-f3d7181c8c74 tempest-ServerActionsTestOtherA-293895743 None] Deleting attachment 66e7835b-9205-4ad1-90aa-6fccc75ef7a6. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:17:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e999768d-220e-480f-89b5-13db400bd3f8 req-e8d59a7e-a64e-40ef-899c-a662001c7bd3 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e999768d-220e-480f-89b5-13db400bd3f8 req-e8d59a7e-a64e-40ef-899c-a662001c7bd3 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e999768d-220e-480f-89b5-13db400bd3f8 req-e8d59a7e-a64e-40ef-899c-a662001c7bd3 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-e999768d-220e-480f-89b5-13db400bd3f8 req-e8d59a7e-a64e-40ef-899c-a662001c7bd3 tempest-ServerActionsTestOtherA-293895743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-f1a117ca-9357-410c-93ff-905f2d60752b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3ef7247-dd35-4d40-873b-4680769eed8f', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:17:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-e999768d-220e-480f-89b5-13db400bd3f8 req-e8d59a7e-a64e-40ef-899c-a662001c7bd3 tempest-ServerActionsTestOtherA-293895743 None] attachment_update completed successfully.
Sep 11 06:17:17 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:17:17 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=16,cinder:UPDATE=2 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Flow 'volume_create_manager' (1ac717b5-2df1-4a3e-af2e-788ba2f36d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9cc517-9724-47e1-b600-cd7144823281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9cc517-9724-47e1-b600-cd7144823281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2024382423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5b4a00-4dcc-4338-9447-1aa5cd818ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d76d42aa20149eea0c3cf06362a40be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:17:25Z,use_quota=True,user_id='4e2efb61f3e7482aa07907e5a357efb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4427d614-a61d-4b27-b2b7-da376ece7a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4427d614-a61d-4b27-b2b7-da376ece7a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f222cf3-eeda-48eb-869e-ccda32a69be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f222cf3-eeda-48eb-869e-ccda32a69be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5b4a00-4dcc-4338-9447-1aa5cd818ad1', 'volume_name': 'volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7703fe0d-6dbf-4489-8b5e-b2a699916f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7703fe0d-6dbf-4489-8b5e-b2a699916f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5922ae0-3d05-455b-9349-4832ba42d60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:25 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Volume 6d5b4a00-4dcc-4338-9447-1aa5cd818ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1', 'volume_size': 1}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2024382423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5b4a00-4dcc-4338-9447-1aa5cd818ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d76d42aa20149eea0c3cf06362a40be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:17:25Z,use_quota=True,user_id='4e2efb61f3e7482aa07907e5a357efb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Creating volume 6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:17:25 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:17:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:25 devstack sudo[92857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 1073741824
Sep 11 06:17:25 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:26 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 1073741824" returned: 0 in 0.919s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:26 devstack sudo[92886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1
Sep 11 06:17:26 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:26 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5922ae0-3d05-455b-9349-4832ba42d60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c42d8c-8f4c-4b81-9741-3d1db46c6979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:26 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Volume volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 (6d5b4a00-4dcc-4338-9447-1aa5cd818ad1): created successfully
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c42d8c-8f4c-4b81-9741-3d1db46c6979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Flow 'volume_create_manager' (1ac717b5-2df1-4a3e-af2e-788ba2f36d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:17:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6ebf3b22-62bc-485c-8f58-2bb014dfe9fd tempest-ServerRescueNegativeTestJSON-211633650 None] Created volume successfully.
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:31 devstack sudo[92962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:17:31 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:31 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.454s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 8 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:17:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:17:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Acquiring lock "cinder-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:17:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "cinder-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:17:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Acquiring lock "cinder-quobyte-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:17:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "cinder-quobyte-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:17:35 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[91824e9c-4562-43d1-b633-cd55b163c421]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:17:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:35 devstack sudo[93022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1
Sep 11 06:17:35 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:36 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1" returned: 0 in 0.581s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:36 devstack sudo[93028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1
Sep 11 06:17:36 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:36 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1" returned: 0 in 0.350s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "cinder-quobyte-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1" released by "delete_volume" :: held 0.999s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Created reservations ['7a8a58f0-0d44-46b7-941f-e642dafe1935', 'ac8c7ceb-8816-4719-a150-b4bb92136271', '7a832c9d-aa96-4790-bf11-22200250858f', '024f47d1-44d2-4ce5-93f2-41683d720b32'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:37 devstack sudo[93037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:17:37 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:37 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.320s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:37 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:17:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Deleted volume successfully.
Sep 11 06:17:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b70aaa17-1aa0-4d64-961b-225687be7d33 tempest-ServerRescueNegativeTestJSON-211633650 None] Lock "cinder-6d5b4a00-4dcc-4338-9447-1aa5cd818ad1-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:17:51 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:17:51 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Flow 'volume_create_manager' (9419c3bd-3938-4ca3-a440-1f91f0c09751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545517c0-6985-405a-81b3-d94372fa6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545517c0-6985-405a-81b3-d94372fa6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-230013822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61508b10-c97a-4940-b709-fe56486df49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba6143320224d7ea80853646fce378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:17:52Z,use_quota=True,user_id='6bb49f7a0da044a4b95fae8cdb5b2566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b821e762-53fc-4d2c-ba35-9678bef72376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b821e762-53fc-4d2c-ba35-9678bef72376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef54e79-8404-4854-8d06-d8a301e2c4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef54e79-8404-4854-8d06-d8a301e2c4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61508b10-c97a-4940-b709-fe56486df49b', 'volume_name': 'volume-61508b10-c97a-4940-b709-fe56486df49b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0a8e05-6b5d-46dd-b761-ae872293031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0a8e05-6b5d-46dd-b761-ae872293031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bc852a-18ad-4386-a935-f0f4e3c5ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Volume 61508b10-c97a-4940-b709-fe56486df49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61508b10-c97a-4940-b709-fe56486df49b', 'volume_size': 1}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-230013822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61508b10-c97a-4940-b709-fe56486df49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba6143320224d7ea80853646fce378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:17:52Z,use_quota=True,user_id='6bb49f7a0da044a4b95fae8cdb5b2566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Creating volume 61508b10-c97a-4940-b709-fe56486df49b {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:17:52 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:52 devstack sudo[93204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b 1073741824
Sep 11 06:17:52 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:52 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b 1073741824" returned: 0 in 0.440s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:52 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b
Sep 11 06:17:52 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:52 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b" returned: 0 in 0.262s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:17:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bc852a-18ad-4386-a935-f0f4e3c5ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61508b10-c97a-4940-b709-fe56486df49b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da45b6f7-3f29-497e-ac58-f125a08b9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Volume volume-61508b10-c97a-4940-b709-fe56486df49b (61508b10-c97a-4940-b709-fe56486df49b): created successfully
Sep 11 06:17:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da45b6f7-3f29-497e-ac58-f125a08b9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Flow 'volume_create_manager' (9419c3bd-3938-4ca3-a440-1f91f0c09751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:17:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-864142f1-767e-4500-b1c3-21dec82660fe tempest-AttachVolumeTestJSON-2000479679 None] Created volume successfully.
Sep 11 06:17:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-4803af0d-cb29-4800-b9ef-4a9c3bb10400 req-6f947ff2-6fd5-4e45-af9c-e15d7e0290da tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-4803af0d-cb29-4800-b9ef-4a9c3bb10400 req-6f947ff2-6fd5-4e45-af9c-e15d7e0290da tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-4803af0d-cb29-4800-b9ef-4a9c3bb10400 req-6f947ff2-6fd5-4e45-af9c-e15d7e0290da tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-4803af0d-cb29-4800-b9ef-4a9c3bb10400 req-6f947ff2-6fd5-4e45-af9c-e15d7e0290da tempest-AttachVolumeTestJSON-2000479679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-61508b10-c97a-4940-b709-fe56486df49b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bf748a4-6e5c-4a8f-a232-6e33be0cc856', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:17:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-4803af0d-cb29-4800-b9ef-4a9c3bb10400 req-6f947ff2-6fd5-4e45-af9c-e15d7e0290da tempest-AttachVolumeTestJSON-2000479679 None] attachment_update completed successfully.
Sep 11 06:17:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-41a01f5e-fc58-4d0a-95a3-3d2d6760e011 req-0663c22c-db2c-4cdc-8b2c-41a60754f57f tempest-ServerActionsTestOtherA-293895743 None] Terminate volume connection completed successfully.
Sep 11 06:17:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-41a01f5e-fc58-4d0a-95a3-3d2d6760e011 req-0663c22c-db2c-4cdc-8b2c-41a60754f57f tempest-ServerActionsTestOtherA-293895743 None] Deleting attachment e3ef7247-dd35-4d40-873b-4680769eed8f. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:17:57 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Flow 'volume_create_manager' (d15e90b8-0e11-4b5b-aa69-3820d9e454eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287ff38d-cdc2-42b3-8670-f61f0d87b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287ff38d-cdc2-42b3-8670-f61f0d87b86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-724759375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c93606-adfa-40c2-b9ed-cc056410f210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba6143320224d7ea80853646fce378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:17:58Z,use_quota=True,user_id='6bb49f7a0da044a4b95fae8cdb5b2566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac2272b-6592-4c85-a0df-27a36d4c12d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac2272b-6592-4c85-a0df-27a36d4c12d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f352b5-f2af-466a-bb90-3f28c4331e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f352b5-f2af-466a-bb90-3f28c4331e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c93606-adfa-40c2-b9ed-cc056410f210', 'volume_name': 'volume-89c93606-adfa-40c2-b9ed-cc056410f210', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79585d7-7caa-42b6-b23f-4d7707d4f86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79585d7-7caa-42b6-b23f-4d7707d4f86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a6e860-55ad-4d19-ad76-4adb6b19014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:58 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Volume 89c93606-adfa-40c2-b9ed-cc056410f210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c93606-adfa-40c2-b9ed-cc056410f210', 'volume_size': 1}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-724759375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c93606-adfa-40c2-b9ed-cc056410f210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba6143320224d7ea80853646fce378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:17:58Z,use_quota=True,user_id='6bb49f7a0da044a4b95fae8cdb5b2566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Creating volume 89c93606-adfa-40c2-b9ed-cc056410f210 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:17:58 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:58 devstack sudo[93262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210 1073741824
Sep 11 06:17:58 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:58 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210 1073741824" returned: 0 in 0.542s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:17:58 devstack sudo[93269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210
Sep 11 06:17:58 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:17:58 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a6e860-55ad-4d19-ad76-4adb6b19014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c93606-adfa-40c2-b9ed-cc056410f210', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f5e999-f15a-4e6b-98d9-a7c6cf23ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:17:59 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Volume volume-89c93606-adfa-40c2-b9ed-cc056410f210 (89c93606-adfa-40c2-b9ed-cc056410f210): created successfully
Sep 11 06:17:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f5e999-f15a-4e6b-98d9-a7c6cf23ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:17:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Flow 'volume_create_manager' (d15e90b8-0e11-4b5b-aa69-3820d9e454eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:17:59 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-645d23ba-bdc4-4af8-9383-d2007f9afe6c tempest-AttachVolumeTestJSON-2000479679 None] Created volume successfully.
Sep 11 06:18:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-62a20522-af32-4857-a4e5-27c27b1f6f17 req-9d320805-4f35-4966-9b73-13ff9f885974 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-62a20522-af32-4857-a4e5-27c27b1f6f17 req-9d320805-4f35-4966-9b73-13ff9f885974 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-62a20522-af32-4857-a4e5-27c27b1f6f17 req-9d320805-4f35-4966-9b73-13ff9f885974 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-62a20522-af32-4857-a4e5-27c27b1f6f17 req-9d320805-4f35-4966-9b73-13ff9f885974 tempest-AttachVolumeTestJSON-2000479679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-89c93606-adfa-40c2-b9ed-cc056410f210', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '470f2266-e7c4-49cf-82a9-8f5482389be3', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:18:01 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-62a20522-af32-4857-a4e5-27c27b1f6f17 req-9d320805-4f35-4966-9b73-13ff9f885974 tempest-AttachVolumeTestJSON-2000479679 None] attachment_update completed successfully.
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Flow 'volume_create_manager' (0083abf7-64db-4855-aa5a-bd7e371a8f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb330b21-c3d0-4b91-a775-698e2d658011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb330b21-c3d0-4b91-a775-698e2d658011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881558127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82305559-4399-454b-9125-a44fda3ac601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433a144315d545e98012d7624ea1e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:02Z,use_quota=True,user_id='f9b03aca2630423287650a93b45f70a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6deb706-b957-46bd-be61-6d628d5f5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6deb706-b957-46bd-be61-6d628d5f5bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a190362e-a4d2-42f2-abaa-caf663f54854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a190362e-a4d2-42f2-abaa-caf663f54854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82305559-4399-454b-9125-a44fda3ac601', 'volume_name': 'volume-82305559-4399-454b-9125-a44fda3ac601', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c76ec2-369d-4003-8736-d58e646f0203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c76ec2-369d-4003-8736-d58e646f0203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198bf14f-3c7b-463e-9a5c-37ff2665a0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:02 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Volume 82305559-4399-454b-9125-a44fda3ac601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82305559-4399-454b-9125-a44fda3ac601', 'volume_size': 1}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881558127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82305559-4399-454b-9125-a44fda3ac601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433a144315d545e98012d7624ea1e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:02Z,use_quota=True,user_id='f9b03aca2630423287650a93b45f70a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Creating volume 82305559-4399-454b-9125-a44fda3ac601 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:18:02 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:02 devstack sudo[93291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601 1073741824
Sep 11 06:18:02 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:02 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601 1073741824" returned: 0 in 0.455s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:02 devstack sudo[93300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601
Sep 11 06:18:02 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:03 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601" returned: 0 in 0.309s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198bf14f-3c7b-463e-9a5c-37ff2665a0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82305559-4399-454b-9125-a44fda3ac601', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d1907b-3edb-417e-8fd0-c4a67fe9750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Volume volume-82305559-4399-454b-9125-a44fda3ac601 (82305559-4399-454b-9125-a44fda3ac601): created successfully
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d1907b-3edb-417e-8fd0-c4a67fe9750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Flow 'volume_create_manager' (0083abf7-64db-4855-aa5a-bd7e371a8f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0336bfbe-6f92-4755-8727-e05e5c83c91a tempest-AttachVolumeNegativeTest-1276398235 None] Created volume successfully.
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Flow 'volume_create_manager' (7bbbad53-e79d-477c-8c87-99da761602f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e3f8a1-a8e7-4522-90d8-0d2f1b584339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e3f8a1-a8e7-4522-90d8-0d2f1b584339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-571838672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f029b5-536d-403b-bcf8-d1de348a7809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d66bf0e444cffa5e57dd800a2fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:04Z,use_quota=True,user_id='b7583879a5f2418ebcb0564dfcc047ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf1dbbb-789d-42ad-be0e-8b0ba4f2bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf1dbbb-789d-42ad-be0e-8b0ba4f2bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3718e923-4f1e-484a-9837-cc7424bd2640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:03 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:18:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-3890b46b-c45b-4010-98af-1c9d8a0c587c req-e280c495-f78b-4f23-baca-14dac058d5a5 tempest-AttachVolumeTestJSON-2000479679 None] Terminate volume connection completed successfully.
Sep 11 06:18:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-3890b46b-c45b-4010-98af-1c9d8a0c587c req-e280c495-f78b-4f23-baca-14dac058d5a5 tempest-AttachVolumeTestJSON-2000479679 None] Deleting attachment 2bf748a4-6e5c-4a8f-a232-6e33be0cc856. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:18:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3718e923-4f1e-484a-9837-cc7424bd2640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27f029b5-536d-403b-bcf8-d1de348a7809', 'volume_name': 'volume-27f029b5-536d-403b-bcf8-d1de348a7809', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316f087d0>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b305628-71c0-405e-be7d-1a5cb6cbf092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b305628-71c0-405e-be7d-1a5cb6cbf092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c089ae8-32c9-40a6-821b-37eee58cfdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Volume 27f029b5-536d-403b-bcf8-d1de348a7809: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27f029b5-536d-403b-bcf8-d1de348a7809', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316f087d0>}
Sep 11 06:18:04 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Trying to clone 27f029b5-536d-403b-bcf8-d1de348a7809 from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:18:04 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:18:04 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c554393-94fa-451d-a10c-aaa46b4fb7a7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:05 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD
Sep 11 06:18:05 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-eb47b57b-3eb2-4a12-bea9-b30193fadc3c req-c90dcb7e-d22e-4d8a-a9c8-2ace2e7b1527 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-eb47b57b-3eb2-4a12-bea9-b30193fadc3c req-c90dcb7e-d22e-4d8a-a9c8-2ace2e7b1527 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-eb47b57b-3eb2-4a12-bea9-b30193fadc3c req-c90dcb7e-d22e-4d8a-a9c8-2ace2e7b1527 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-eb47b57b-3eb2-4a12-bea9-b30193fadc3c req-c90dcb7e-d22e-4d8a-a9c8-2ace2e7b1527 tempest-AttachVolumeNegativeTest-1276398235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-82305559-4399-454b-9125-a44fda3ac601', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2140ad0-dce3-495f-baac-46ab3b35cdf3', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:18:05 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 is fetched for user b7583879a5f2418ebcb0564dfcc047ed. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:18:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-eb47b57b-3eb2-4a12-bea9-b30193fadc3c req-c90dcb7e-d22e-4d8a-a9c8-2ace2e7b1527 tempest-AttachVolumeNegativeTest-1276398235 None] attachment_update completed successfully.
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da38985-d158-4976-94f2-c6c5e293722e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:06 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD
Sep 11 06:18:06 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-e807ad57-b7b5-41b6-914f-3c0a7c0503b6 req-295aec0e-9707-4e8f-8b8a-a62be35b8aed tempest-AttachVolumeTestJSON-2000479679 None] Terminate volume connection completed successfully.
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-e807ad57-b7b5-41b6-914f-3c0a7c0503b6 req-295aec0e-9707-4e8f-8b8a-a62be35b8aed tempest-AttachVolumeTestJSON-2000479679 None] Deleting attachment 470f2266-e7c4-49cf-82a9-8f5482389be3. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:18:06 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-571838672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f029b5-536d-403b-bcf8-d1de348a7809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d66bf0e444cffa5e57dd800a2fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:04Z,use_quota=True,user_id='b7583879a5f2418ebcb0564dfcc047ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Creating volume 27f029b5-536d-403b-bcf8-d1de348a7809 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:18:06 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:18:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:06 devstack sudo[93378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 1073741824
Sep 11 06:18:06 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:06 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 1073741824" returned: 0 in 0.621s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:07 devstack sudo[93384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809
Sep 11 06:18:07 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:07 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809" returned: 0 in 0.337s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Attempting download of 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume 27f029b5-536d-403b-bcf8-d1de348a7809. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e5165-7070-481d-b283-5a6eef5f9e18]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_9b985qh6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:07 devstack sudo[93391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_9b985qh6
Sep 11 06:18:07 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:08 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_9b985qh6" returned: 0 in 0.649s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_9b985qh6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:08 devstack sudo[93419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_9b985qh6
Sep 11 06:18:08 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:08 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_9b985qh6" returned: 1 in 0.457s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_9b985qh6' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:18:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[50707f8a-0f1e-449e-9196-243d21669fb6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:08 devstack sudo[93456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD
Sep 11 06:18:08 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:09 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:09 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] 02c3cc94-2cbe-438e-96aa-813e3f248ce8 was qcow2, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:18:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:09 devstack sudo[93482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809
Sep 11 06:18:09 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:11 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809" returned: 0 in 2.726s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:11 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_5vpn147udevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:18:11 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Converted 112.00 MB image at 41.02 MB/s
Sep 11 06:18:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:11 devstack sudo[93508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 1G
Sep 11 06:18:11 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:12 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 1G" returned: 0 in 0.462s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Downloaded image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume 27f029b5-536d-403b-bcf8-d1de348a7809 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 for user b7583879a5f2418ebcb0564dfcc047ed is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Marking volume 27f029b5-536d-403b-bcf8-d1de348a7809 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Copying metadata from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 to 27f029b5-536d-403b-bcf8-d1de348a7809. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Creating volume glance metadata for volume 27f029b5-536d-403b-bcf8-d1de348a7809 backed by image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c089ae8-32c9-40a6-821b-37eee58cfdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f029b5-536d-403b-bcf8-d1de348a7809', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316f087d0>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd94cd3-7a22-427b-91ed-678baf684afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Volume volume-27f029b5-536d-403b-bcf8-d1de348a7809 (27f029b5-536d-403b-bcf8-d1de348a7809): created successfully
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd94cd3-7a22-427b-91ed-678baf684afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Flow 'volume_create_manager' (7bbbad53-e79d-477c-8c87-99da761602f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-889eb53a-dac8-48c7-a1b6-84b93b38bb43 tempest-ServerActionsTestOtherA-293895743 None] Created volume successfully.
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "cinder-89c93606-adfa-40c2-b9ed-cc056410f210-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-89c93606-adfa-40c2-b9ed-cc056410f210-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "cinder-quobyte-89c93606-adfa-40c2-b9ed-cc056410f210" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-quobyte-89c93606-adfa-40c2-b9ed-cc056410f210" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd95e72-c981-49f6-a9c1-69c209e38895]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:13 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210
Sep 11 06:18:13 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:13 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210" returned: 0 in 0.563s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:14 devstack sudo[93522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210
Sep 11 06:18:14 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:14 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89c93606-adfa-40c2-b9ed-cc056410f210" returned: 0 in 0.469s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-quobyte-89c93606-adfa-40c2-b9ed-cc056410f210" released by "delete_volume" :: held 1.113s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Created reservations ['d5d55884-ef63-4663-8580-c36d2ddba756', '0ea74cf0-d99c-4de4-b805-bedf4c861d36', '6ca46986-c814-45a4-9e08-db33a4667301', '8efcbb0b-0a73-4676-a02c-9b57cf60ada1'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:14 devstack sudo[93528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:18:14 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:15 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.428s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:18:15 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Deleted volume successfully.
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f592670c-ab7e-4766-a039-efbf23614585 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-89c93606-adfa-40c2-b9ed-cc056410f210-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "cinder-61508b10-c97a-4940-b709-fe56486df49b-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-61508b10-c97a-4940-b709-fe56486df49b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "cinder-quobyte-61508b10-c97a-4940-b709-fe56486df49b" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-quobyte-61508b10-c97a-4940-b709-fe56486df49b" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0d6352-030b-49cd-93f8-91b0cdfec597]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:16 devstack sudo[93536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b
Sep 11 06:18:16 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:16 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b" returned: 0 in 0.913s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:16 devstack sudo[93546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b
Sep 11 06:18:16 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:17 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-61508b10-c97a-4940-b709-fe56486df49b" returned: 0 in 0.472s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-quobyte-61508b10-c97a-4940-b709-fe56486df49b" released by "delete_volume" :: held 1.495s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Created reservations ['0b8783d5-7933-4d62-a269-6336587b77ea', 'f81de08b-713a-4711-94f7-45c35a059f67', 'ae270431-7322-4dd1-8127-64fa689f066f', '5cebae96-e091-4b45-8b10-29dd134556b6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:17 devstack sudo[93559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:18:17 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:18 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.545s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:18 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:18:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Deleted volume successfully.
Sep 11 06:18:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f7c41a7f-0db0-4d8c-b410-409b15a1de61 tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-61508b10-c97a-4940-b709-fe56486df49b-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-ab2cc67d-b46d-4fb8-a49e-6afba4db1a54 req-2cb1c88b-1b86-4938-a7f7-429089ed6f2c tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-ab2cc67d-b46d-4fb8-a49e-6afba4db1a54 req-2cb1c88b-1b86-4938-a7f7-429089ed6f2c tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-ab2cc67d-b46d-4fb8-a49e-6afba4db1a54 req-2cb1c88b-1b86-4938-a7f7-429089ed6f2c tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-ab2cc67d-b46d-4fb8-a49e-6afba4db1a54 req-2cb1c88b-1b86-4938-a7f7-429089ed6f2c tempest-ServerActionsTestOtherA-293895743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-27f029b5-536d-403b-bcf8-d1de348a7809', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09f25b63-ebf1-48a8-aa28-82fcd7f246fe', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:18:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-ab2cc67d-b46d-4fb8-a49e-6afba4db1a54 req-2cb1c88b-1b86-4938-a7f7-429089ed6f2c tempest-ServerActionsTestOtherA-293895743 None] attachment_update completed successfully.
Sep 11 06:18:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "cinder-cd97be01-f72b-49b2-803a-9a69d712cd1b-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-cd97be01-f72b-49b2-803a-9a69d712cd1b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "cinder-quobyte-cd97be01-f72b-49b2-803a-9a69d712cd1b" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-quobyte-cd97be01-f72b-49b2-803a-9a69d712cd1b" acquired by "delete_volume" :: waited 0.052s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae62de8-a0c9-4b61-a9d7-b4ee22846e7e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:19 devstack sudo[93573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b
Sep 11 06:18:19 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:20 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b" returned: 0 in 0.700s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:20 devstack sudo[93590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b
Sep 11 06:18:20 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:20 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cd97be01-f72b-49b2-803a-9a69d712cd1b" returned: 0 in 0.497s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-quobyte-cd97be01-f72b-49b2-803a-9a69d712cd1b" released by "delete_volume" :: held 1.268s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Created reservations ['92b9b1d1-c64a-42a8-bf13-47d2e9d3f5bf', 'f140efd7-8e8a-46e2-b0d5-e8d4767d10f5', 'a454ca06-4a80-4651-9e2c-dbfc204a66e2', '22775d45-dc10-4036-ad4f-7f5c90a2c46d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:21 devstack sudo[93631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:18:21 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:21 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.344s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:21 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:18:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Deleted volume successfully.
Sep 11 06:18:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2de54e3c-35f9-458f-911f-c77015248eef tempest-AttachVolumeTestJSON-2000479679 None] Lock "cinder-cd97be01-f72b-49b2-803a-9a69d712cd1b-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:30 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=40,cinder:SELECT=59,cinder:INSERT=17,cinder:DELETE=3 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:31 devstack sudo[93780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:18:31 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=60,cinder:UPDATE=47,cinder:DELETE=4,cinder:INSERT=12 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:18:31 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.721s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:18:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Flow 'volume_create_manager' (c33e7888-fc40-4e6d-b570-611f01422db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4b59fc-6279-4fbf-80e5-3dd70b46ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4b59fc-6279-4fbf-80e5-3dd70b46ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-899303860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff364a19edc4a8d9d782b87f853747c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:43Z,use_quota=True,user_id='197d62cb871a46f093fc950882b79e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90d3710-9520-49c2-8cad-dc39bf15c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90d3710-9520-49c2-8cad-dc39bf15c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c83636-f549-4f22-a668-b9d2d082eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c83636-f549-4f22-a668-b9d2d082eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1', 'volume_name': 'volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00daead5-fb71-45a4-9ffe-d174b9b6eab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00daead5-fb71-45a4-9ffe-d174b9b6eab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16d4ce1-406b-4cee-a9d5-797beabbadee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Volume 73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1', 'volume_size': 1}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-899303860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff364a19edc4a8d9d782b87f853747c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:43Z,use_quota=True,user_id='197d62cb871a46f093fc950882b79e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Creating volume 73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:18:43 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:18:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:43 devstack sudo[93843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 1073741824
Sep 11 06:18:43 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:18:44 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Flow 'volume_create_manager' (1f0fb1db-59ab-4181-b639-5d96169f02e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43889f2b-6aea-4158-a092-98ceb5fee1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 1073741824" returned: 0 in 1.152s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43889f2b-6aea-4158-a092-98ceb5fee1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1247672244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6d9533-9446-4b1c-8ac9-276be88f88fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3ce44a6650442a8feb61fac0c862e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:44Z,use_quota=True,user_id='9b08c53b25e74ea6b977b0f04c46db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea3b765-f11b-4160-8aa9-cf7f6ca65349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea3b765-f11b-4160-8aa9-cf7f6ca65349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4104695f-0945-4eab-8502-f4bace32d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4104695f-0945-4eab-8502-f4bace32d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6d9533-9446-4b1c-8ac9-276be88f88fa', 'volume_name': 'volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa4dfd1-c9a0-4f3e-a078-da327ea50a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa4dfd1-c9a0-4f3e-a078-da327ea50a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac69d9db-36a4-41cd-98b4-f423f954fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:44 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Volume fd6d9533-9446-4b1c-8ac9-276be88f88fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa', 'volume_size': 1}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:44 devstack sudo[93896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1
Sep 11 06:18:44 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:45 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" returned: 0 in 0.354s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1247672244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6d9533-9446-4b1c-8ac9-276be88f88fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3ce44a6650442a8feb61fac0c862e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:44Z,use_quota=True,user_id='9b08c53b25e74ea6b977b0f04c46db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Creating volume fd6d9533-9446-4b1c-8ac9-276be88f88fa {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:18:45 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:45 devstack sudo[93899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa 1073741824
Sep 11 06:18:45 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16d4ce1-406b-4cee-a9d5-797beabbadee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3232d3d-d3df-42d0-8aee-13d4264eb66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Volume volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 (73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1): created successfully
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3232d3d-d3df-42d0-8aee-13d4264eb66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Flow 'volume_create_manager' (c33e7888-fc40-4e6d-b570-611f01422db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-f1db6e5b-98e2-47ca-8891-21e43f5231c4 req-7870ff64-fc32-49f7-8dab-32b29126c949 tempest-VolumesSnapshotsTestJSON-292961579 None] Created volume successfully.
Sep 11 06:18:45 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa 1073741824" returned: 0 in 0.600s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:45 devstack sudo[93905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa
Sep 11 06:18:45 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:46 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa" returned: 0 in 0.378s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.281s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac69d9db-36a4-41cd-98b4-f423f954fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f30fa4-1987-4e41-96d8-380efff34f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:46 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Volume volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa (fd6d9533-9446-4b1c-8ac9-276be88f88fa): created successfully
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f30fa4-1987-4e41-96d8-380efff34f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Flow 'volume_create_manager' (1f0fb1db-59ab-4181-b639-5d96169f02e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Creating offline snapshot c2a3c9ca-4816-4064-84c6-7a4a76396f86 of volume 73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:18:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a948478b-f2a4-419e-9c1c-e7f002e0ddf3 tempest-ServersNegativeTestJSON-1437438822 None] Created volume successfully.
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8358a84-56eb-4e8a-af8c-aea07f06f06f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:46 devstack sudo[93909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1
Sep 11 06:18:46 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-1e25bf0e-9ad4-49de-86b9-d593bb1950ce req-b68886aa-f3bf-497a-9524-8fc0df7d3b6b tempest-ServerActionsTestOtherA-293895743 None] Terminate volume connection completed successfully.
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-1e25bf0e-9ad4-49de-86b9-d593bb1950ce req-b68886aa-f3bf-497a-9524-8fc0df7d3b6b tempest-ServerActionsTestOtherA-293895743 None] Deleting attachment 09f25b63-ebf1-48a8-aa28-82fcd7f246fe. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:18:46 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" returned: 0 in 0.522s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:46 devstack sudo[93936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 1G
Sep 11 06:18:46 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:47 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 1G" returned: 0 in 0.455s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:47 devstack sudo[93944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86
Sep 11 06:18:47 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:47 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86" returned: 0 in 0.432s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:47 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 is being set with open permissions: ugo+rw
Sep 11 06:18:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:47 devstack sudo[93950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86
Sep 11 06:18:47 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:48 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86" returned: 0 in 0.268s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:48 devstack sudo[93953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.info
Sep 11 06:18:48 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:48 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.info" returned: 0 in 0.315s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:48 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.info is being set with open permissions: ugo+rw
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:48 devstack sudo[93963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.info
Sep 11 06:18:48 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-1e25bf0e-9ad4-49de-86b9-d593bb1950ce req-e3e92d16-50bd-46a6-a944-c6dbd7e24698 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:48 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.info" returned: 0 in 0.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-1e25bf0e-9ad4-49de-86b9-d593bb1950ce req-e3e92d16-50bd-46a6-a944-c6dbd7e24698 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.163s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-1e25bf0e-9ad4-49de-86b9-d593bb1950ce req-e3e92d16-50bd-46a6-a944-c6dbd7e24698 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-74d1a52f-5289-4b8a-a704-2662c294aa9d req-8ab94acd-eb9e-42cc-8a4d-8499540ea76f tempest-VolumesSnapshotsTestJSON-292961579 None] Create snapshot completed successfully
Sep 11 06:18:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-1e25bf0e-9ad4-49de-86b9-d593bb1950ce req-e3e92d16-50bd-46a6-a944-c6dbd7e24698 tempest-ServerActionsTestOtherA-293895743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-27f029b5-536d-403b-bcf8-d1de348a7809', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93abeee6-ce32-44aa-b27c-1a5d5d5cc53e', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:18:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-1e25bf0e-9ad4-49de-86b9-d593bb1950ce req-e3e92d16-50bd-46a6-a944-c6dbd7e24698 tempest-ServerActionsTestOtherA-293895743 None] attachment_update completed successfully.
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Flow 'volume_create_manager' (9de1c504-8059-4ef2-b5df-44311dff3ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adc76ef-1a99-4684-84f8-f19d9588ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4adc76ef-1a99-4684-84f8-f19d9588ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2103214242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7aa88e-dd7f-48eb-a16d-82abf3c887ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3ce44a6650442a8feb61fac0c862e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:49Z,use_quota=True,user_id='9b08c53b25e74ea6b977b0f04c46db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4e2b69-5fc9-4e71-bdfa-7f60730fff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4e2b69-5fc9-4e71-bdfa-7f60730fff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783945b0-9433-4fe4-909e-b5acf6848f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783945b0-9433-4fe4-909e-b5acf6848f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7aa88e-dd7f-48eb-a16d-82abf3c887ff', 'volume_name': 'volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf34575-f570-445c-83e9-17735e96a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf34575-f570-445c-83e9-17735e96a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e686f658-2dec-4190-b4ba-83a916425545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Volume 7a7aa88e-dd7f-48eb-a16d-82abf3c887ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff', 'volume_size': 1}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2103214242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7aa88e-dd7f-48eb-a16d-82abf3c887ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3ce44a6650442a8feb61fac0c862e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:18:49Z,use_quota=True,user_id='9b08c53b25e74ea6b977b0f04c46db88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Creating volume 7a7aa88e-dd7f-48eb-a16d-82abf3c887ff {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:18:49 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:49 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff 1073741824
Sep 11 06:18:49 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "cinder-c2a3c9ca-4816-4064-84c6-7a4a76396f86-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-c2a3c9ca-4816-4064-84c6-7a4a76396f86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "cinder-quobyte-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-quobyte-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "cinder-quobyte-c2a3c9ca-4816-4064-84c6-7a4a76396f86" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-quobyte-c2a3c9ca-4816-4064-84c6-7a4a76396f86" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Deleting offline snapshot c2a3c9ca-4816-4064-84c6-7a4a76396f86 of volume 73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] snapshot_file for this snap is: volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc35d96c-1310-4dca-8966-6042eb87c510]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:49 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff 1073741824" returned: 0 in 0.744s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:50 devstack sudo[94011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff
Sep 11 06:18:50 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:50 devstack sudo[94009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86
Sep 11 06:18:50 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:50 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff" returned: 0 in 0.549s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e686f658-2dec-4190-b4ba-83a916425545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87955cc5-14f4-451b-b596-515e2cc8cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:18:50 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Volume volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff (7a7aa88e-dd7f-48eb-a16d-82abf3c887ff): created successfully
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87955cc5-14f4-451b-b596-515e2cc8cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Flow 'volume_create_manager' (9de1c504-8059-4ef2-b5df-44311dff3ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:18:50 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7a597f9a-92c3-4afe-ae15-c0ac41ec5918 tempest-ServersNegativeTestJSON-1437438822 None] Created volume successfully.
Sep 11 06:18:50 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86" returned: 0 in 0.774s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b0fce1-eeec-405b-8d1a-81f48b6516e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:50 devstack sudo[94019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1
Sep 11 06:18:50 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:51 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" returned: 0 in 0.405s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:51 devstack sudo[94024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86
Sep 11 06:18:51 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:51 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86" returned: 0 in 0.664s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:51 devstack sudo[94032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86
Sep 11 06:18:51 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "cinder-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "cinder-quobyte-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-quobyte-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff" acquired by "delete_volume" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc74e2de-fb61-455c-896a-6a3b57c4a8fb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:52 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:52 devstack sudo[94034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff
Sep 11 06:18:52 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1.c2a3c9ca-4816-4064-84c6-7a4a76396f86" returned: 0 in 0.469s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-quobyte-c2a3c9ca-4816-4064-84c6-7a4a76396f86" released by "_delete_snapshot" :: held 2.471s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-quobyte-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" released by "delete_snapshot" :: held 2.529s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:52 devstack cinder-volume[88109]: WARNING cinder.quota [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG cinder.quota [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Created reservations ['8d009673-7a79-4fef-8ab3-e491a78a1fdc', 'c2a33fcd-03a0-48d9-809b-068188428b56', 'b74c5686-0387-45a4-8dfe-10e430049f44', '9b89ff48-a0eb-4dad-a223-97e4a97a0da3'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:18:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Delete snapshot completed successfully.
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-58a87df2-4cd7-4937-bf06-20152b250f2b req-597db8cb-416b-4b67-872b-3f88a6da6e83 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-c2a3c9ca-4816-4064-84c6-7a4a76396f86-delete_snapshot" released by "delete_snapshot" :: held 2.835s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:52 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff" returned: 0 in 0.578s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:52 devstack sudo[94055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff
Sep 11 06:18:52 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:53 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-quobyte-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff" released by "delete_volume" :: held 1.085s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Created reservations ['6f562c16-ede8-4939-b1f3-50700cd2fd25', '90312791-03f9-44b2-8d21-cb545706e306', '9aa6a5b4-8a6c-4edf-9db2-0bdb4414b3e9', '30a224a4-c12e-43f1-881f-9d3fd2914359'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "cinder-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:53 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:18:53 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "cinder-quobyte-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-quobyte-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" acquired by "delete_volume" :: waited 0.049s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe3d3b5-3402-4028-bebf-9d4388a391dc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:54 devstack sudo[94062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1
Sep 11 06:18:54 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:54 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.715s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:18:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Deleted volume successfully.
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b32510d-b3be-48b4-85dc-fe7d3f8dc112 tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-7a7aa88e-dd7f-48eb-a16d-82abf3c887ff-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "cinder-fd6d9533-9446-4b1c-8ac9-276be88f88fa-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-fd6d9533-9446-4b1c-8ac9-276be88f88fa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "cinder-quobyte-fd6d9533-9446-4b1c-8ac9-276be88f88fa" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-quobyte-fd6d9533-9446-4b1c-8ac9-276be88f88fa" acquired by "delete_volume" :: waited 0.056s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aaef13-e4b0-46d2-a255-6748a14ee66e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:54 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" returned: 0 in 1.032s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:54 devstack sudo[94076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1
Sep 11 06:18:54 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:55 devstack sudo[94075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa
Sep 11 06:18:55 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:55 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" returned: 0 in 0.746s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-quobyte-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1" released by "delete_volume" :: held 1.914s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG cinder.quota [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Created reservations ['b95bc1a4-b908-47e9-a67a-79a02d60c81b', '3a5a8bfe-0037-4c7e-ad02-f853d6056b77', '820a798b-6b2d-45e0-a7b5-0b42f017dfe3', '94f8f5bd-3f79-4a89-a73f-66d0e837fe71'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:18:55 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa" returned: 0 in 1.170s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:55 devstack sudo[94102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa
Sep 11 06:18:55 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:56 devstack sudo[94104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:18:56 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:56 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fd6d9533-9446-4b1c-8ac9-276be88f88fa" returned: 0 in 0.596s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-quobyte-fd6d9533-9446-4b1c-8ac9-276be88f88fa" released by "delete_volume" :: held 1.873s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Created reservations ['7bd099a6-7acd-4974-93b3-00b39e12de95', '81e75034-69b2-457f-b1c5-6581d9052e4e', '02984e09-52eb-4c10-bf39-75ccaa5ae5d6', 'a3c722d6-7051-4406-ac3a-549810761d74'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:18:56 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.765s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG cinder.manager [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:18:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Deleted volume successfully.
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-1f00ab63-4984-4bf7-8f2b-b781022ee093 req-9919846b-4f96-4064-9b8e-68f7528a0545 tempest-VolumesSnapshotsTestJSON-292961579 None] Lock "cinder-73e3bd8b-78e3-4886-8ad2-fb6ba851e9a1-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:18:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:18:57 devstack sudo[94108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:18:57 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:18:57 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root
Sep 11 06:18:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.446s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:18:57 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:18:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Deleted volume successfully.
Sep 11 06:18:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-af497bf3-89bf-460a-b713-38b53cdd859a tempest-ServersNegativeTestJSON-1437438822 None] Lock "cinder-fd6d9533-9446-4b1c-8ac9-276be88f88fa-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-1c541af6-9314-482e-ba58-25498b22460d req-b8e13f3d-0c1c-4d11-9731-ab6677d5e65d tempest-AttachVolumeNegativeTest-1276398235 None] Terminate volume connection completed successfully.
Sep 11 06:19:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-1c541af6-9314-482e-ba58-25498b22460d req-b8e13f3d-0c1c-4d11-9731-ab6677d5e65d tempest-AttachVolumeNegativeTest-1276398235 None] Deleting attachment c2140ad0-dce3-495f-baac-46ab3b35cdf3. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Flow 'volume_create_manager' (5dcbcc57-fa4f-4da4-b09b-044735f7cf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5661ad94-d142-4601-b1a4-099677add9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5661ad94-d142-4601-b1a4-099677add9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-481634038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa3d0c8-8774-4d8d-8ade-7559fd7a30f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6abeb54f52349a09321d996aa1c11b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:03Z,use_quota=True,user_id='f239ce38072d4094abde4feecef2aa64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6319fcfe-ae57-4267-adbb-98118880f6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6319fcfe-ae57-4267-adbb-98118880f6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d49524-7694-45bd-846c-2aa942b9ff25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d49524-7694-45bd-846c-2aa942b9ff25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa3d0c8-8774-4d8d-8ade-7559fd7a30f4', 'volume_name': 'volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715673d7-466e-4335-9df7-d0059f369536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715673d7-466e-4335-9df7-d0059f369536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b3e844-2715-49c5-ae7a-0df8de161f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Volume baa3d0c8-8774-4d8d-8ade-7559fd7a30f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4', 'volume_size': 1}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-481634038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa3d0c8-8774-4d8d-8ade-7559fd7a30f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6abeb54f52349a09321d996aa1c11b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:03Z,use_quota=True,user_id='f239ce38072d4094abde4feecef2aa64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Creating volume baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:03 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:03 devstack sudo[94144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 1073741824
Sep 11 06:19:03 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:04 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 1073741824" returned: 0 in 0.734s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:04 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4
Sep 11 06:19:04 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:04 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4" returned: 0 in 0.540s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b3e844-2715-49c5-ae7a-0df8de161f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d5dcda-ed05-4bba-9d5f-3e705d8cf152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Volume volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 (baa3d0c8-8774-4d8d-8ade-7559fd7a30f4): created successfully
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d5dcda-ed05-4bba-9d5f-3e705d8cf152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Flow 'volume_create_manager' (5dcbcc57-fa4f-4da4-b09b-044735f7cf37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-d38111bc-8613-4f8c-bc03-515d57c9f9ef req-55f06f73-4b5b-4e5e-95c3-673e128add4c tempest-VolumesGetTestJSON-572503420 None] Created volume successfully.
Sep 11 06:19:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Acquiring lock "cinder-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Lock "cinder-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Acquiring lock "cinder-quobyte-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Lock "cinder-quobyte-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4" acquired by "delete_volume" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb421c70-cc63-4b98-a881-dff48c8900ce]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:05 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4
Sep 11 06:19:05 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:06 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:06 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4
Sep 11 06:19:06 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:06 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Lock "cinder-quobyte-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4" released by "delete_volume" :: held 0.818s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG cinder.quota [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Created reservations ['9449969f-d40e-4e0a-8b6c-e6e810205c30', '882aa6b2-1e88-42fc-a107-6ce8aa530972', 'cc683819-9012-471a-a010-1e72f0eda189', '78a6771c-6e31-4cda-9f78-5a006dd04145'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:06 devstack sudo[94190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:19:06 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:07 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.510s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:07 devstack cinder-volume[88109]: DEBUG cinder.manager [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:19:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Deleted volume successfully.
Sep 11 06:19:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f32a6712-854a-434b-b401-e34d629edf0b req-4cf78cf3-85dd-46eb-95e6-72fda10d3835 tempest-VolumesGetTestJSON-572503420 None] Lock "cinder-baa3d0c8-8774-4d8d-8ade-7559fd7a30f4-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cf9e1a0f-7e6a-4746-ab8e-45905b7c277a tempest-GroupSnapshotsTest-173601636 None] Group tempest-GroupSnapshotsTest-Group-1149392198: creating
Sep 11 06:19:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cf9e1a0f-7e6a-4746-ab8e-45905b7c277a tempest-GroupSnapshotsTest-173601636 None] Group tempest-GroupSnapshotsTest-Group-1149392198: created successfully
Sep 11 06:19:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cf9e1a0f-7e6a-4746-ab8e-45905b7c277a tempest-GroupSnapshotsTest-173601636 None] Create group completed successfully.
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (c655f598-f7bc-4632-b4da-254a23697aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f504cadd-78a0-45e6-af32-7a7e6ab0641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f504cadd-78a0-45e6-af32-7a7e6ab0641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2061763104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dedc5a2c-40e4-4f85-9c16-49b13edee3f0,host='devstack@QuobyteHD#QuobyteHD',id=004dbf0f-21b4-47da-a7dc-15f883bc7f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:15Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ffe555f-d42d-42d3-b654-ca5dbae61c6b),volume_type_id=6ffe555f-d42d-42d3-b654-ca5dbae61c6b)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4e9350-f7ff-443d-afcd-d91cefede8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4e9350-f7ff-443d-afcd-d91cefede8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6111996-9d24-4ef7-92da-3ae4f6179209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6111996-9d24-4ef7-92da-3ae4f6179209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004dbf0f-21b4-47da-a7dc-15f883bc7f38', 'volume_name': 'volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb249096-5159-4f11-94fe-4a4de06cd3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb249096-5159-4f11-94fe-4a4de06cd3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5194be4-82d9-4d5f-a443-2bdde4f35b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:15 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Volume 004dbf0f-21b4-47da-a7dc-15f883bc7f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38', 'volume_size': 1}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dedc5a2c-40e4-4f85-9c16-49b13edee3f0,created_at=2026-09-11T04:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2061763104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dedc5a2c-40e4-4f85-9c16-49b13edee3f0,host='devstack@QuobyteHD#QuobyteHD',id=004dbf0f-21b4-47da-a7dc-15f883bc7f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:15Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ffe555f-d42d-42d3-b654-ca5dbae61c6b),volume_type_id=6ffe555f-d42d-42d3-b654-ca5dbae61c6b)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Creating volume 004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:15 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:15 devstack sudo[94223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 1073741824
Sep 11 06:19:15 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:16 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 1073741824" returned: 0 in 0.575s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:16 devstack sudo[94234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38
Sep 11 06:19:16 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:16 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38" returned: 0 in 0.262s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5194be4-82d9-4d5f-a443-2bdde4f35b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45b5f98-7046-4ff8-9c3b-a49986f667f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:16 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Volume volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 (004dbf0f-21b4-47da-a7dc-15f883bc7f38): created successfully
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45b5f98-7046-4ff8-9c3b-a49986f667f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (c655f598-f7bc-4632-b4da-254a23697aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-78e6fee7-52a0-4edb-8362-0b625aff6209 tempest-GroupSnapshotsTest-173601636 None] Created volume successfully.
Sep 11 06:19:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] GroupSnapshot 8e5b1aec-349d-4c83-a753-e2293972e59f: creating.
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Group snapshot 8e5b1aec-349d-4c83-a753-e2293972e59f: creating. {{(pid=88109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Creating offline snapshot dfb1614e-248d-42f8-a4fa-648e942e22e7 of volume 004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb7b0e8-0104-4762-8576-c9573ec8d7a6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:17 devstack sudo[94237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38
Sep 11 06:19:17 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:17 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38" returned: 0 in 0.407s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:17 devstack sudo[94245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 1G
Sep 11 06:19:17 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:18 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 1G" returned: 0 in 0.471s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:18 devstack sudo[94251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7
Sep 11 06:19:18 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:18 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7" returned: 0 in 0.657s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:18 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:19:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:18 devstack sudo[94299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7
Sep 11 06:19:18 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:19 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7" returned: 0 in 0.405s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:19 devstack sudo[94318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.info
Sep 11 06:19:19 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:19 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.info" returned: 0 in 0.433s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:19 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:19:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:19 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.info
Sep 11 06:19:19 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:20 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.info" returned: 0 in 0.402s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5eddedac-6164-4ad2-9a7e-70ad1372c090 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 8e5b1aec-349d-4c83-a753-e2293972e59f: created successfully
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-dfb1614e-248d-42f8-a4fa-648e942e22e7-a9073264-f052-405a-a7ad-0a0b8766a9d1" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-dfb1614e-248d-42f8-a4fa-648e942e22e7-a9073264-f052-405a-a7ad-0a0b8766a9d1" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Creating volume a9073264-f052-405a-a7ad-0a0b8766a9d1 from snapshot dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-a9073264-f052-405a-a7ad-0a0b8766a9d1" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-a9073264-f052-405a-a7ad-0a0b8766a9d1" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] snapshot: dfb1614e-248d-42f8-a4fa-648e942e22e7, volume: a9073264-f052-405a-a7ad-0a0b8766a9d1,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcccfad-c173-4276-909f-ed050c1f534f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:23 devstack sudo[94375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7
Sep 11 06:19:23 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:23 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7" returned: 0 in 0.934s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:19:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a876ae-5441-4510-8bf1-3aaf70a91a0b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:24 devstack sudo[94398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38
Sep 11 06:19:24 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:24 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38" returned: 0 in 0.767s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:19:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:19:24 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:19:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:24 devstack sudo[94411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1
Sep 11 06:19:24 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:30 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-9e61a378-4f36-4db5-83d7-98b7598ec945 tempest-ServerActionsTestOtherA-293895743 None] Terminate volume connection completed successfully.
Sep 11 06:19:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-9e61a378-4f36-4db5-83d7-98b7598ec945 tempest-ServerActionsTestOtherA-293895743 None] Deleting attachment 93abeee6-ce32-44aa-b27c-1a5d5d5cc53e. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:31 devstack sudo[94441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:19:31 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "cinder-27f029b5-536d-403b-bcf8-d1de348a7809-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-27f029b5-536d-403b-bcf8-d1de348a7809-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "cinder-quobyte-27f029b5-536d-403b-bcf8-d1de348a7809" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-quobyte-27f029b5-536d-403b-bcf8-d1de348a7809" acquired by "delete_volume" :: waited 0.051s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed676408-3330-46ab-897b-22b310230e12]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:32 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.894s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:32 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:19:32 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:19:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:19:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:19:32 devstack sudo[94444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809
Sep 11 06:19:32 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:33 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809" returned: 0 in 1.510s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:33 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809
Sep 11 06:19:33 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:33 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1" returned: 0 in 9.144s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:33 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38, size 1024.00 MB, duration 9.15 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:19:33 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Converted 1024.00 MB image at 111.95 MB/s
Sep 11 06:19:33 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:19:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:33 devstack sudo[94488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1
Sep 11 06:19:33 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:34 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-27f029b5-536d-403b-bcf8-d1de348a7809" returned: 0 in 0.849s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-quobyte-27f029b5-536d-403b-bcf8-d1de348a7809" released by "delete_volume" :: held 2.535s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "cinder-f1a117ca-9357-410c-93ff-905f2d60752b-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-f1a117ca-9357-410c-93ff-905f2d60752b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.quota [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Created reservations ['f648bcd9-7e73-4897-8eb6-c55f439a1b73', 'de95360d-570e-4a56-8c48-b680d9c3343b', 'c3144ade-3271-48ff-a1a1-edd09230e0c2', '001e7726-e30b-41b0-8d1a-1a996d2e8a5e'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "cinder-quobyte-f1a117ca-9357-410c-93ff-905f2d60752b" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-quobyte-f1a117ca-9357-410c-93ff-905f2d60752b" acquired by "delete_volume" :: waited 0.079s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b0b120-3b2e-42f0-830f-0e67c72c218a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:34 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1" returned: 0 in 0.632s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-a9073264-f052-405a-a7ad-0a0b8766a9d1" released by "_copy_volume_from_snapshot" :: held 11.681s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-dfb1614e-248d-42f8-a4fa-648e942e22e7-a9073264-f052-405a-a7ad-0a0b8766a9d1" released by "_create_volume_from_snapshot" :: held 11.827s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.859s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:34 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:19:34 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:34 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b
Sep 11 06:19:34 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-dc0aea4e-5ecd-48b3-9fc5-9f4986869d1c tempest-GroupSnapshotsTest-173601636 None] Create group from source-snapshot-8e5b1aec-349d-4c83-a753-e2293972e59f completed successfully.
Sep 11 06:19:34 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.301s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.manager [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:19:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Deleted volume successfully.
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-0e5f2469-9449-4eb1-98eb-34449235ded8 req-c027f122-b406-496a-99e0-17317f0ad674 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-27f029b5-536d-403b-bcf8-d1de348a7809-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:34 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b" returned: 0 in 0.529s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:35 devstack sudo[94500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b
Sep 11 06:19:35 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:35 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f1a117ca-9357-410c-93ff-905f2d60752b" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-quobyte-f1a117ca-9357-410c-93ff-905f2d60752b" released by "delete_volume" :: held 0.905s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Created reservations ['422ff37b-83b0-4989-9b0e-77ada251f9c3', 'bb56a8de-4e2b-4a7e-8e06-018c863d3584', '314e305d-081e-4add-a4ea-1ed25400187f', '0bddf250-cc7c-4dce-a184-bf5d1bdf1619'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:35 devstack sudo[94503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:19:35 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:35 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.357s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:19:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Deleted volume successfully.
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-a9073264-f052-405a-a7ad-0a0b8766a9d1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d91f67bc-5718-4d99-bde8-c0d168775913 tempest-ServerActionsTestOtherA-293895743 None] Lock "cinder-f1a117ca-9357-410c-93ff-905f2d60752b-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-a9073264-f052-405a-a7ad-0a0b8766a9d1" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457cb9c-0aac-4417-b8ef-848a8feba96b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:36 devstack sudo[94509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1
Sep 11 06:19:36 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:36 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1" returned: 0 in 0.583s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:36 devstack sudo[94533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1
Sep 11 06:19:36 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:36 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a9073264-f052-405a-a7ad-0a0b8766a9d1" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-a9073264-f052-405a-a7ad-0a0b8766a9d1" released by "delete_volume" :: held 0.916s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:36 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Created reservations ['98e85033-5b0b-4dae-b445-4bf7b0847753'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:36 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1743869926 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1743869926, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:19:36 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1743869926 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1743869926, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:19:36 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Created reservations ['87b56b09-f736-47b3-ab42-f0ae1c3bc757', 'cba057ef-e8ff-4a2e-9b03-3a87a3cfad30', '514e2f59-c847-4769-9bf0-ce7f6879d910', '7679526a-35bf-415a-9cf4-2669de3bbc8b'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:37 devstack sudo[94537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:19:37 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 8e5b1aec-349d-4c83-a753-e2293972e59f: deleting
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 8e5b1aec-349d-4c83-a753-e2293972e59f: deleting {{(pid=88109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-004dbf0f-21b4-47da-a7dc-15f883bc7f38" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-004dbf0f-21b4-47da-a7dc-15f883bc7f38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-dfb1614e-248d-42f8-a4fa-648e942e22e7" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-dfb1614e-248d-42f8-a4fa-648e942e22e7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Deleting offline snapshot dfb1614e-248d-42f8-a4fa-648e942e22e7 of volume 004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] snapshot_file for this snap is: volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0183a2f8-cbcf-4c3d-b6bb-02dbf3cfdf8b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:37 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.467s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:19:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7447316e-466f-47de-8b62-9d6676de401a tempest-GroupSnapshotsTest-173601636 None] Delete group completed successfully.
Sep 11 06:19:37 devstack sudo[94540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7
Sep 11 06:19:37 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:37 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7" returned: 0 in 0.544s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9c079-a17f-4643-a911-31b4e76b37fc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:38 devstack sudo[94548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38
Sep 11 06:19:38 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:38 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38" returned: 0 in 0.602s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:38 devstack sudo[94556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7
Sep 11 06:19:38 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:39 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7" returned: 0 in 0.413s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:39 devstack sudo[94563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7
Sep 11 06:19:39 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:39 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38.dfb1614e-248d-42f8-a4fa-648e942e22e7" returned: 0 in 0.291s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-dfb1614e-248d-42f8-a4fa-648e942e22e7" released by "_delete_snapshot" :: held 1.994s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-004dbf0f-21b4-47da-a7dc-15f883bc7f38" released by "delete_snapshot" :: held 2.024s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:39 devstack cinder-volume[88109]: WARNING cinder.quota [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1743869926 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1743869926, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:19:39 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['97c95644-be18-4052-97ae-a5807d505e26', 'eb9482b9-999f-40a5-9e16-588c06b1574e', '106ad074-4e96-4c3f-8ea4-e452ac2a3f39', 'c6d2ee6b-34e0-4424-9f29-82552b8f0ac7'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1f062798-f1eb-4e5b-b3f3-d49d56f8a6c9 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 8e5b1aec-349d-4c83-a753-e2293972e59f: deleted successfully
Sep 11 06:19:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-004dbf0f-21b4-47da-a7dc-15f883bc7f38" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:19:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-004dbf0f-21b4-47da-a7dc-15f883bc7f38" acquired by "delete_volume" :: waited 0.047s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:19:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d55afb-7065-4760-8182-e3f3fb439184]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:40 devstack sudo[94569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38
Sep 11 06:19:40 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:40 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38" returned: 0 in 0.595s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:40 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38
Sep 11 06:19:40 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:41 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-004dbf0f-21b4-47da-a7dc-15f883bc7f38" returned: 0 in 0.348s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-004dbf0f-21b4-47da-a7dc-15f883bc7f38" released by "delete_volume" :: held 1.056s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=78,cinder:INSERT=22,cinder:UPDATE=90,cinder:DELETE=11 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['dced29c4-da96-4d62-b862-d602c2f8571d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:41 devstack cinder-volume[88109]: WARNING cinder.db.api [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1743869926']
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['cb816983-730c-41c6-b34f-3c306290f5e0', '778f9699-af38-457a-8aae-eb7b25a2d247', 'ced1f331-9497-48b1-a357-8f487c557f47', '37e2b8af-af0b-4efb-93f8-0345b35ed862'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=107,cinder:SELECT=106,cinder:INSERT=27,cinder:DELETE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:41 devstack sudo[94590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:19:41 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:41 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.336s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:41 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:19:41 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d0703c45-46c4-4641-bfa2-3a54b1ef8966 tempest-GroupSnapshotsTest-173601636 None] Delete group completed successfully.
Sep 11 06:19:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-48c4bbeb-37d9-4c0b-9bf4-4d879f3db925 tempest-GroupSnapshotsTest-173601636 None] Group tempest-GroupSnapshotsTest-Group-667039175: creating
Sep 11 06:19:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-48c4bbeb-37d9-4c0b-9bf4-4d879f3db925 tempest-GroupSnapshotsTest-173601636 None] Group tempest-GroupSnapshotsTest-Group-667039175: created successfully
Sep 11 06:19:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-48c4bbeb-37d9-4c0b-9bf4-4d879f3db925 tempest-GroupSnapshotsTest-173601636 None] Create group completed successfully.
Sep 11 06:19:45 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Flow 'volume_create_manager' (2c17e632-7f1e-4d59-a3ad-0c631a13eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f527c134-b352-4eac-b984-a770554d2db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f527c134-b352-4eac-b984-a770554d2db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-964922776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c543fb30-f828-454c-8e24-ab8401848cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433a144315d545e98012d7624ea1e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:46Z,use_quota=True,user_id='f9b03aca2630423287650a93b45f70a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c98c899-15c5-43fd-9be7-e366241b2807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c98c899-15c5-43fd-9be7-e366241b2807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac594242-aaed-4e1d-b9e6-ce2da44f0f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac594242-aaed-4e1d-b9e6-ce2da44f0f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c543fb30-f828-454c-8e24-ab8401848cd8', 'volume_name': 'volume-c543fb30-f828-454c-8e24-ab8401848cd8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec0cdff-89d5-405d-a77d-e4fdb3189df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec0cdff-89d5-405d-a77d-e4fdb3189df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc37ed61-bfcf-413f-a32e-9fc6b24e4b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Volume c543fb30-f828-454c-8e24-ab8401848cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c543fb30-f828-454c-8e24-ab8401848cd8', 'volume_size': 1}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-964922776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c543fb30-f828-454c-8e24-ab8401848cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433a144315d545e98012d7624ea1e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:46Z,use_quota=True,user_id='f9b03aca2630423287650a93b45f70a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Creating volume c543fb30-f828-454c-8e24-ab8401848cd8 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:46 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (392ac65f-f46f-4480-bdd8-588c4a38c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:46 devstack sudo[94691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8 1073741824
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae940ea-223a-4a19-91ef-53d8c5b0e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae940ea-223a-4a19-91ef-53d8c5b0e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898511498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8c3fe66d-bf1c-4063-8d8e-c38704c7c29b,host='devstack@QuobyteHD#QuobyteHD',id=b74dc64f-4e9d-4643-b3b3-914556593b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:46Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1f8cf6d-742d-4b9b-a920-5327e2a6e58a),volume_type_id=f1f8cf6d-742d-4b9b-a920-5327e2a6e58a)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fc0a14-896e-489f-82b6-5500b12b862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fc0a14-896e-489f-82b6-5500b12b862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6997b53-5e4e-48b5-bcd6-4c5bd359a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6997b53-5e4e-48b5-bcd6-4c5bd359a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74dc64f-4e9d-4643-b3b3-914556593b98', 'volume_name': 'volume-b74dc64f-4e9d-4643-b3b3-914556593b98', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c474bc-f159-4065-a720-59d9635f1800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c474bc-f159-4065-a720-59d9635f1800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3178499f-6fba-4ea5-b26b-61ab343e4a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:46 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Volume b74dc64f-4e9d-4643-b3b3-914556593b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74dc64f-4e9d-4643-b3b3-914556593b98', 'volume_size': 1}
Sep 11 06:19:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:47 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8 1073741824" returned: 0 in 0.821s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:47 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8
Sep 11 06:19:47 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:47 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8" returned: 0 in 0.553s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8c3fe66d-bf1c-4063-8d8e-c38704c7c29b,created_at=2026-09-11T04:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898511498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8c3fe66d-bf1c-4063-8d8e-c38704c7c29b,host='devstack@QuobyteHD#QuobyteHD',id=b74dc64f-4e9d-4643-b3b3-914556593b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:46Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1f8cf6d-742d-4b9b-a920-5327e2a6e58a),volume_type_id=f1f8cf6d-742d-4b9b-a920-5327e2a6e58a)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Creating volume b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:47 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc37ed61-bfcf-413f-a32e-9fc6b24e4b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c543fb30-f828-454c-8e24-ab8401848cd8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:47 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 1073741824
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf5544a-2f4c-4b2b-8592-f56a130dc3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:47 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:47 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Volume volume-c543fb30-f828-454c-8e24-ab8401848cd8 (c543fb30-f828-454c-8e24-ab8401848cd8): created successfully
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf5544a-2f4c-4b2b-8592-f56a130dc3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Flow 'volume_create_manager' (2c17e632-7f1e-4d59-a3ad-0c631a13eed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-526d8006-a297-462e-8279-43b5fdce6085 tempest-AttachVolumeNegativeTest-1276398235 None] Created volume successfully.
Sep 11 06:19:48 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 1073741824" returned: 0 in 0.767s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:48 devstack sudo[94709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98
Sep 11 06:19:48 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:48 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98" returned: 0 in 0.356s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3178499f-6fba-4ea5-b26b-61ab343e4a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74dc64f-4e9d-4643-b3b3-914556593b98', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b2155b-2f57-4b3f-b04d-b567f8bc6a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:48 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Volume volume-b74dc64f-4e9d-4643-b3b3-914556593b98 (b74dc64f-4e9d-4643-b3b3-914556593b98): created successfully
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b2155b-2f57-4b3f-b04d-b567f8bc6a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (392ac65f-f46f-4480-bdd8-588c4a38c43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-033028ec-59d9-41cb-b8e2-e6e62905db30 tempest-GroupSnapshotsTest-173601636 None] Created volume successfully.
Sep 11 06:19:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e737c6ab-53d8-4fa4-ae2f-f224f26f4966 req-274e04c0-2cb9-4bee-b07b-ab401dead6a0 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e737c6ab-53d8-4fa4-ae2f-f224f26f4966 req-274e04c0-2cb9-4bee-b07b-ab401dead6a0 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e737c6ab-53d8-4fa4-ae2f-f224f26f4966 req-274e04c0-2cb9-4bee-b07b-ab401dead6a0 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-e737c6ab-53d8-4fa4-ae2f-f224f26f4966 req-274e04c0-2cb9-4bee-b07b-ab401dead6a0 tempest-AttachVolumeNegativeTest-1276398235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-c543fb30-f828-454c-8e24-ab8401848cd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '472c6852-8a11-4ee5-8919-665ffebda0ac', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:19:50 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-e737c6ab-53d8-4fa4-ae2f-f224f26f4966 req-274e04c0-2cb9-4bee-b07b-ab401dead6a0 tempest-AttachVolumeNegativeTest-1276398235 None] attachment_update completed successfully.
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (7a9497d9-17f5-4fc5-8860-5453653769c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e25d5da-5467-4691-a068-a49ad9df0495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e25d5da-5467-4691-a068-a49ad9df0495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4473017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8c3fe66d-bf1c-4063-8d8e-c38704c7c29b,host='devstack@QuobyteHD#QuobyteHD',id=0f688b20-b533-4fd6-aa47-478b4f24e25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:51Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1f8cf6d-742d-4b9b-a920-5327e2a6e58a),volume_type_id=f1f8cf6d-742d-4b9b-a920-5327e2a6e58a)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489f3308-5156-4336-a0f2-ce2c3768d709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489f3308-5156-4336-a0f2-ce2c3768d709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef5eb90-027d-4951-b148-d738e272d8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef5eb90-027d-4951-b148-d738e272d8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f688b20-b533-4fd6-aa47-478b4f24e25e', 'volume_name': 'volume-0f688b20-b533-4fd6-aa47-478b4f24e25e', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0a3952-e33a-4794-943f-6972bbb008ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0a3952-e33a-4794-943f-6972bbb008ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d04b97d-ac07-4007-b611-83d56f29986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:50 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Volume 0f688b20-b533-4fd6-aa47-478b4f24e25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f688b20-b533-4fd6-aa47-478b4f24e25e', 'volume_size': 1}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8c3fe66d-bf1c-4063-8d8e-c38704c7c29b,created_at=2026-09-11T04:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4473017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8c3fe66d-bf1c-4063-8d8e-c38704c7c29b,host='devstack@QuobyteHD#QuobyteHD',id=0f688b20-b533-4fd6-aa47-478b4f24e25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:51Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1f8cf6d-742d-4b9b-a920-5327e2a6e58a),volume_type_id=f1f8cf6d-742d-4b9b-a920-5327e2a6e58a)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Creating volume 0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:50 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:50 devstack sudo[95107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e 1073741824
Sep 11 06:19:50 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:51 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e 1073741824" returned: 0 in 0.618s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:51 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e
Sep 11 06:19:51 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:51 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e" returned: 0 in 0.291s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d04b97d-ac07-4007-b611-83d56f29986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f688b20-b533-4fd6-aa47-478b4f24e25e', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21df51a-28a0-49e8-a1a8-d21a862ec415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:51 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Volume volume-0f688b20-b533-4fd6-aa47-478b4f24e25e (0f688b20-b533-4fd6-aa47-478b4f24e25e): created successfully
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21df51a-28a0-49e8-a1a8-d21a862ec415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (7a9497d9-17f5-4fc5-8860-5453653769c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9795c552-506f-4173-8648-4f09d00a2f31 tempest-GroupSnapshotsTest-173601636 None] Created volume successfully.
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Flow 'volume_create_manager' (52e118a1-6d17-4af2-8595-e1a2d901d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3227d6b-0ea9-470e-915a-35e5b0bca7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3227d6b-0ea9-470e-915a-35e5b0bca7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-356279744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c3f3b4-07fb-466c-b597-81286eee9d21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed8a4ca0d4c1432e9fd513c55f348bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:52Z,use_quota=True,user_id='448a26f3a4744e91bc7e5b07a4ac3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69bec8c-6e75-471d-866f-27cc5a42b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69bec8c-6e75-471d-866f-27cc5a42b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2296c6aa-c40f-4278-a4c0-57a0b34a74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2296c6aa-c40f-4278-a4c0-57a0b34a74b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c3f3b4-07fb-466c-b597-81286eee9d21', 'volume_name': 'volume-f4c3f3b4-07fb-466c-b597-81286eee9d21', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54386355-ab14-4ab0-a9c9-42f594641885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54386355-ab14-4ab0-a9c9-42f594641885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8745fd24-3af2-4db8-87e0-7fb8623b0abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Volume f4c3f3b4-07fb-466c-b597-81286eee9d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c3f3b4-07fb-466c-b597-81286eee9d21', 'volume_size': 1}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-356279744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c3f3b4-07fb-466c-b597-81286eee9d21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed8a4ca0d4c1432e9fd513c55f348bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:52Z,use_quota=True,user_id='448a26f3a4744e91bc7e5b07a4ac3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Creating volume f4c3f3b4-07fb-466c-b597-81286eee9d21 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:52 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:52 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21 1073741824
Sep 11 06:19:52 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-8d146042-8b73-4df4-a541-6beb8500a8e2 req-15472e72-86a4-403a-bc26-a6218eedc72d tempest-AttachVolumeNegativeTest-1276398235 None] Terminate volume connection completed successfully.
Sep 11 06:19:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-8d146042-8b73-4df4-a541-6beb8500a8e2 req-15472e72-86a4-403a-bc26-a6218eedc72d tempest-AttachVolumeNegativeTest-1276398235 None] Deleting attachment 472c6852-8a11-4ee5-8919-665ffebda0ac. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:19:53 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21 1073741824" returned: 0 in 0.504s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:53 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21
Sep 11 06:19:53 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-dd9b4828-fd15-4c98-a33d-cccdeea212c4 tempest-GroupSnapshotsTest-173601636 None] Update group completed successfully.
Sep 11 06:19:53 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21" returned: 0 in 0.306s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8745fd24-3af2-4db8-87e0-7fb8623b0abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c3f3b4-07fb-466c-b597-81286eee9d21', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303e84b8-60ac-4b0f-825d-a31649ba1a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Volume volume-f4c3f3b4-07fb-466c-b597-81286eee9d21 (f4c3f3b4-07fb-466c-b597-81286eee9d21): created successfully
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303e84b8-60ac-4b0f-825d-a31649ba1a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Flow 'volume_create_manager' (52e118a1-6d17-4af2-8595-e1a2d901d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cf558bce-e85b-43cc-b05b-23ad79df1111 tempest-VolumesTestJSON-1294337818 None] Created volume successfully.
Sep 11 06:19:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4217e51c-3f7d-40b7-a5c9-6569873850c2 tempest-GroupSnapshotsTest-173601636 None] Update group completed successfully.
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Flow 'volume_create_manager' (6fc24f87-3eae-4846-bff5-1f718a6e7b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a13fd1-665d-43f2-a374-6b411b95c65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a13fd1-665d-43f2-a374-6b411b95c65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-697350084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b9daf3-63a7-4c12-9d59-77cda5620329,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed8a4ca0d4c1432e9fd513c55f348bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:56Z,use_quota=True,user_id='448a26f3a4744e91bc7e5b07a4ac3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8e0c65-3765-4291-ac27-1633f764823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8e0c65-3765-4291-ac27-1633f764823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cbabb0-fce9-4266-b15d-5e13a5110e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cbabb0-fce9-4266-b15d-5e13a5110e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b9daf3-63a7-4c12-9d59-77cda5620329', 'volume_name': 'volume-06b9daf3-63a7-4c12-9d59-77cda5620329', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a14373-36ba-4776-9185-99231b5f7b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a14373-36ba-4776-9185-99231b5f7b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e085e37-7d15-49f5-bab8-6f5eeb265932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:55 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Volume 06b9daf3-63a7-4c12-9d59-77cda5620329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b9daf3-63a7-4c12-9d59-77cda5620329', 'volume_size': 1}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-697350084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b9daf3-63a7-4c12-9d59-77cda5620329,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed8a4ca0d4c1432e9fd513c55f348bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:56Z,use_quota=True,user_id='448a26f3a4744e91bc7e5b07a4ac3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Creating volume 06b9daf3-63a7-4c12-9d59-77cda5620329 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:55 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:55 devstack sudo[95173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329 1073741824
Sep 11 06:19:55 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3b420bfe-816b-41b0-be52-4c19ee5ad159 tempest-GroupSnapshotsTest-173601636 None] Update group completed successfully.
Sep 11 06:19:56 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329 1073741824" returned: 0 in 0.581s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:56 devstack sudo[95181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329
Sep 11 06:19:56 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:56 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329" returned: 0 in 0.292s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e085e37-7d15-49f5-bab8-6f5eeb265932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b9daf3-63a7-4c12-9d59-77cda5620329', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc41c728-68f3-43ce-ae1b-e01cdcfe49c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:56 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Volume volume-06b9daf3-63a7-4c12-9d59-77cda5620329 (06b9daf3-63a7-4c12-9d59-77cda5620329): created successfully
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc41c728-68f3-43ce-ae1b-e01cdcfe49c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Flow 'volume_create_manager' (6fc24f87-3eae-4846-bff5-1f718a6e7b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-51e079fe-375b-4154-9346-e8b39f54071a tempest-VolumesTestJSON-1294337818 None] Created volume successfully.
Sep 11 06:19:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9e4e5304-cb9d-4ce6-8e4b-73885bdf8a60 tempest-GroupSnapshotsTest-173601636 None] Update group completed successfully.
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Flow 'volume_create_manager' (77021804-cf39-4474-aea5-a2bcfbc4a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95081356-0d61-4004-9611-5f6e06cb21e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95081356-0d61-4004-9611-5f6e06cb21e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1010447754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e49a1f-8d23-4c41-a506-f24f82ead9cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed8a4ca0d4c1432e9fd513c55f348bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:58Z,use_quota=True,user_id='448a26f3a4744e91bc7e5b07a4ac3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd72f7e5-e066-40e4-b6f6-8479fa6f6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd72f7e5-e066-40e4-b6f6-8479fa6f6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f8b566-ac35-447f-9429-37576a7831e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f8b566-ac35-447f-9429-37576a7831e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e49a1f-8d23-4c41-a506-f24f82ead9cf', 'volume_name': 'volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2eaf3cc-6413-4799-85a1-943eb9a12963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2eaf3cc-6413-4799-85a1-943eb9a12963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dad00aa-26f0-41c0-a36e-eb7a0b44f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:58 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Volume 48e49a1f-8d23-4c41-a506-f24f82ead9cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf', 'volume_size': 1}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1010447754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e49a1f-8d23-4c41-a506-f24f82ead9cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed8a4ca0d4c1432e9fd513c55f348bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:19:58Z,use_quota=True,user_id='448a26f3a4744e91bc7e5b07a4ac3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Creating volume 48e49a1f-8d23-4c41-a506-f24f82ead9cf {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:19:58 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:58 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf 1073741824
Sep 11 06:19:58 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:58 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] GroupSnapshot 3f80eb44-9f5e-4c85-8c12-3a823e23ea12: creating.
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Group snapshot 3f80eb44-9f5e-4c85-8c12-3a823e23ea12: creating. {{(pid=88109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 06:19:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:19:59 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf 1073741824" returned: 0 in 0.575s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:59 devstack sudo[95204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf
Sep 11 06:19:59 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:59 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf" returned: 0 in 0.278s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.408s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dad00aa-26f0-41c0-a36e-eb7a0b44f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12f4746-492d-4c10-8a7f-3bf174236763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Creating offline snapshot 34f96761-a3c4-43b7-b57c-43f2f090ff00 of volume b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:19:59 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Volume volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf (48e49a1f-8d23-4c41-a506-f24f82ead9cf): created successfully
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12f4746-492d-4c10-8a7f-3bf174236763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Flow 'volume_create_manager' (77021804-cf39-4474-aea5-a2bcfbc4a27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2bdf70-8bcc-4e8c-b17a-b8aa6214e79f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:59 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a8ca96f7-bd2f-4045-b69e-5d4215e4560c tempest-VolumesTestJSON-1294337818 None] Created volume successfully.
Sep 11 06:19:59 devstack sudo[95207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98
Sep 11 06:19:59 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:19:59 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98" returned: 0 in 0.367s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:19:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:19:59 devstack sudo[95212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 1G
Sep 11 06:19:59 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:00 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 1G" returned: 0 in 0.456s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b74dc64f-4e9d-4643-b3b3-914556593b98 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:00 devstack sudo[95218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b74dc64f-4e9d-4643-b3b3-914556593b98 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00
Sep 11 06:20:00 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:00 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b74dc64f-4e9d-4643-b3b3-914556593b98 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00" returned: 0 in 0.362s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:00 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:00 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00
Sep 11 06:20:00 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:00 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:00 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.info
Sep 11 06:20:00 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Acquiring lock "cinder-48e49a1f-8d23-4c41-a506-f24f82ead9cf-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Lock "cinder-48e49a1f-8d23-4c41-a506-f24f82ead9cf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Acquiring lock "cinder-quobyte-48e49a1f-8d23-4c41-a506-f24f82ead9cf" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:01 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Lock "cinder-quobyte-48e49a1f-8d23-4c41-a506-f24f82ead9cf" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.info" returned: 0 in 0.352s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:01 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3dd701-5ca4-4a7b-b18c-d5e548416569]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:01 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.info
Sep 11 06:20:01 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:01 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf
Sep 11 06:20:01 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:01 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.info" returned: 0 in 0.253s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Creating offline snapshot 356a42ff-f38d-420e-88fb-8ae85bac1471 of volume 0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f21851-68c0-499d-906c-5e85de973c70]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:01 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf" returned: 0 in 0.406s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:01 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e
Sep 11 06:20:01 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:01 devstack sudo[95238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf
Sep 11 06:20:01 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:01 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48e49a1f-8d23-4c41-a506-f24f82ead9cf" returned: 0 in 0.273s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Lock "cinder-quobyte-48e49a1f-8d23-4c41-a506-f24f82ead9cf" released by "delete_volume" :: held 0.731s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:02 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e" returned: 0 in 0.408s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:02 devstack sudo[95245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 1G
Sep 11 06:20:02 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Created reservations ['a5268958-bcc9-494b-9761-ce760c880a35', 'ddef62e8-6dfd-4227-a8ad-6a1e1ac199b2', '7483952d-5d70-428c-8349-4e15feb58a5c', '0bf3e13a-a894-405d-a27f-5073aec0248a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:02 devstack sudo[95250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:02 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Acquiring lock "cinder-06b9daf3-63a7-4c12-9d59-77cda5620329-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Lock "cinder-06b9daf3-63a7-4c12-9d59-77cda5620329-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Acquiring lock "cinder-quobyte-06b9daf3-63a7-4c12-9d59-77cda5620329" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Lock "cinder-quobyte-06b9daf3-63a7-4c12-9d59-77cda5620329" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51f95eb-80ed-496a-aa3c-8f0e1f5ed0ea]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:02 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.333s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Deleted volume successfully.
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-919d0464-a86b-4a63-9b34-32ed077f5643 tempest-VolumesTestJSON-1294337818 None] Lock "cinder-48e49a1f-8d23-4c41-a506-f24f82ead9cf-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:02 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 1G" returned: 0 in 0.620s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f688b20-b533-4fd6-aa47-478b4f24e25e -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:02 devstack sudo[95258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f688b20-b533-4fd6-aa47-478b4f24e25e -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471
Sep 11 06:20:02 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:02 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329
Sep 11 06:20:02 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:02 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f688b20-b533-4fd6-aa47-478b4f24e25e -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471" returned: 0 in 0.342s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:02 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:02 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329" returned: 0 in 0.464s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:02 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471
Sep 11 06:20:02 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:03 devstack sudo[95270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329
Sep 11 06:20:03 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:03 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471" returned: 0 in 0.284s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:03 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-06b9daf3-63a7-4c12-9d59-77cda5620329" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Lock "cinder-quobyte-06b9daf3-63a7-4c12-9d59-77cda5620329" released by "delete_volume" :: held 0.818s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:03 devstack sudo[95275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.info
Sep 11 06:20:03 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Created reservations ['17aa7a1c-505e-4845-a0a4-cb82765603e5', 'ffe365e6-624a-4a34-9d89-d486d3787fad', '18c71779-7fd2-4dde-bf46-1cdbdcb0da93', '2aad30ec-5a1a-4d4e-8d17-6e4c23cdd8ce'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:03 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:03 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Acquiring lock "cinder-f4c3f3b4-07fb-466c-b597-81286eee9d21-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Lock "cinder-f4c3f3b4-07fb-466c-b597-81286eee9d21-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Acquiring lock "cinder-quobyte-f4c3f3b4-07fb-466c-b597-81286eee9d21" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Lock "cinder-quobyte-f4c3f3b4-07fb-466c-b597-81286eee9d21" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:03 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a757aa73-81c6-4b06-9493-f226280adc46]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.info" returned: 0 in 0.530s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:03 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:03 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.383s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:03 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.info
Sep 11 06:20:03 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Deleted volume successfully.
Sep 11 06:20:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cefda110-5d2b-4b57-aea8-609b8a68042a tempest-VolumesTestJSON-1294337818 None] Lock "cinder-06b9daf3-63a7-4c12-9d59-77cda5620329-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:03 devstack sudo[95282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21
Sep 11 06:20:03 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:04 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.info" returned: 0 in 0.350s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.662s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:04 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21" returned: 0 in 0.503s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:04 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21
Sep 11 06:20:04 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b86c21d5-122c-4770-978e-42583d2eb6c0 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 3f80eb44-9f5e-4c85-8c12-3a823e23ea12: created successfully
Sep 11 06:20:04 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4c3f3b4-07fb-466c-b597-81286eee9d21" returned: 0 in 0.352s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Lock "cinder-quobyte-f4c3f3b4-07fb-466c-b597-81286eee9d21" released by "delete_volume" :: held 0.924s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Created reservations ['00ca30b9-1b87-4def-8032-e880bdc6dc2e', '6a74f38b-ab18-4534-9e55-af6554129ea6', '41664d09-7f84-44be-95e8-6b705b07fc59', 'a16f9ac9-2694-4086-a88a-4c80847d5050'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:04 devstack sudo[95310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:04 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:05 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.249s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Deleted volume successfully.
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fafecfbc-7242-492e-b1ea-5802b7f512eb tempest-VolumesTestJSON-1294337818 None] Lock "cinder-f4c3f3b4-07fb-466c-b597-81286eee9d21-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 3f80eb44-9f5e-4c85-8c12-3a823e23ea12: deleting
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 3f80eb44-9f5e-4c85-8c12-3a823e23ea12: deleting {{(pid=88109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-b74dc64f-4e9d-4643-b3b3-914556593b98" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-b74dc64f-4e9d-4643-b3b3-914556593b98" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-34f96761-a3c4-43b7-b57c-43f2f090ff00" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-34f96761-a3c4-43b7-b57c-43f2f090ff00" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Deleting offline snapshot 34f96761-a3c4-43b7-b57c-43f2f090ff00 of volume b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] snapshot_file for this snap is: volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aeb01a-30f9-4959-a67f-0817f4cd4188]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:05 devstack sudo[95313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00
Sep 11 06:20:05 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:06 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00" returned: 0 in 0.474s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b74dc64f-4e9d-4643-b3b3-914556593b98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:20:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6931021-ca3a-4b02-b4be-d635de0addb4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:06 devstack sudo[95319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98
Sep 11 06:20:06 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:06 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98" returned: 0 in 0.580s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:06 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00
Sep 11 06:20:06 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:07 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00" returned: 0 in 0.959s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:07 devstack sudo[95391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00
Sep 11 06:20:07 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:08 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98.34f96761-a3c4-43b7-b57c-43f2f090ff00" returned: 0 in 0.568s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-34f96761-a3c4-43b7-b57c-43f2f090ff00" released by "_delete_snapshot" :: held 2.720s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-b74dc64f-4e9d-4643-b3b3-914556593b98" released by "delete_snapshot" :: held 2.753s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-0f688b20-b533-4fd6-aa47-478b4f24e25e" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-0f688b20-b533-4fd6-aa47-478b4f24e25e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-356a42ff-f38d-420e-88fb-8ae85bac1471" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-356a42ff-f38d-420e-88fb-8ae85bac1471" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Deleting offline snapshot 356a42ff-f38d-420e-88fb-8ae85bac1471 of volume 0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] snapshot_file for this snap is: volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b2489-c42c-4ebb-b641-f82d00029d18]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:08 devstack sudo[95401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471
Sep 11 06:20:08 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:08 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471" returned: 0 in 0.509s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f688b20-b533-4fd6-aa47-478b4f24e25e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09943ec1-19ed-47d3-a64c-33fc9976ca21]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:09 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e
Sep 11 06:20:09 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:09 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e" returned: 0 in 0.873s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:09 devstack sudo[95416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471
Sep 11 06:20:09 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Flow 'volume_create_manager' (b1fb1706-f698-4299-8c33-56c068e64940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94ed939-5250-42d2-b3b5-c959af00a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94ed939-5250-42d2-b3b5-c959af00a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-382016457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564f78de-abfe-4bf0-91aa-b8c4f6376b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22df1b7c49fd49f0ad261e13e507b46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:10Z,use_quota=True,user_id='dcb3806c3e8546408804715c0d7cc00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4241f8b9-5620-4d95-93bd-9d4b708f7ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4241f8b9-5620-4d95-93bd-9d4b708f7ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad37c53-ce40-4fcb-bcf0-3681ee0a70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad37c53-ce40-4fcb-bcf0-3681ee0a70ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564f78de-abfe-4bf0-91aa-b8c4f6376b96', 'volume_name': 'volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b195c6bb-d565-44ba-98f1-3048417039ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b195c6bb-d565-44ba-98f1-3048417039ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160d7bfd-0fb5-48c6-a686-633e2a30a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Volume 564f78de-abfe-4bf0-91aa-b8c4f6376b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96', 'volume_size': 1}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-382016457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564f78de-abfe-4bf0-91aa-b8c4f6376b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22df1b7c49fd49f0ad261e13e507b46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:10Z,use_quota=True,user_id='dcb3806c3e8546408804715c0d7cc00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Creating volume 564f78de-abfe-4bf0-91aa-b8c4f6376b96 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:20:10 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:10 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96 1073741824
Sep 11 06:20:10 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:10 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471" returned: 0 in 0.590s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:10 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471
Sep 11 06:20:10 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:10 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e.356a42ff-f38d-420e-88fb-8ae85bac1471" returned: 0 in 0.338s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-356a42ff-f38d-420e-88fb-8ae85bac1471" released by "_delete_snapshot" :: held 2.483s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-0f688b20-b533-4fd6-aa47-478b4f24e25e" released by "delete_snapshot" :: held 2.557s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:10 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96 1073741824" returned: 0 in 0.753s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:11 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2115549299 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2115549299, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:11 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2115549299 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2115549299, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['1ae4a9b1-b8cf-466d-b0f4-1be71a118ec3', '4ddeb33f-969d-4e11-9b06-95f9f4b41032', 'a7b73681-88c8-4356-b06f-b8676022b330', '31c46f35-b4ac-4bae-bd70-e3b7501e1377'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:11 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96
Sep 11 06:20:11 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['c632cbb4-5fb0-4355-9e27-9f8c56770bdc', '8134700f-3eac-4942-a743-41b64f330f96', 'fbc619ca-9b57-487b-923d-cbf23c86c21f', 'cbc246ff-92c0-47e3-9480-d193c99de701'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7130e9e0-d47e-4f2d-b82c-f0796b2b17e3 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 3f80eb44-9f5e-4c85-8c12-3a823e23ea12: deleted successfully
Sep 11 06:20:11 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96" returned: 0 in 0.483s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160d7bfd-0fb5-48c6-a686-633e2a30a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbadd6d-3778-457f-83c5-fd80f7ab2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:11 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Volume volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96 (564f78de-abfe-4bf0-91aa-b8c4f6376b96): created successfully
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbadd6d-3778-457f-83c5-fd80f7ab2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Flow 'volume_create_manager' (b1fb1706-f698-4299-8c33-56c068e64940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f676e5df-b854-4533-9732-3de6455fbd22 tempest-AttachVolumeShelveTestJSON-704949995 None] Created volume successfully.
Sep 11 06:20:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-0f688b20-b533-4fd6-aa47-478b4f24e25e" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-0f688b20-b533-4fd6-aa47-478b4f24e25e" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[61add7cb-2d41-41c3-a0ae-813b656278a0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:13 devstack sudo[95439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e
Sep 11 06:20:13 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:13 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e" returned: 0 in 0.655s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:13 devstack sudo[95445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e
Sep 11 06:20:13 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a811ff16-dedc-4f1b-8b84-b861637863e6 tempest-GroupSnapshotsV319Test-1088418156 None] Group tempest-GroupSnapshotsV319Test-Group-433282730: creating
Sep 11 06:20:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a811ff16-dedc-4f1b-8b84-b861637863e6 tempest-GroupSnapshotsV319Test-1088418156 None] Group tempest-GroupSnapshotsV319Test-Group-433282730: created successfully
Sep 11 06:20:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a811ff16-dedc-4f1b-8b84-b861637863e6 tempest-GroupSnapshotsV319Test-1088418156 None] Create group completed successfully.
Sep 11 06:20:14 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0f688b20-b533-4fd6-aa47-478b4f24e25e" returned: 0 in 0.482s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-0f688b20-b533-4fd6-aa47-478b4f24e25e" released by "delete_volume" :: held 1.271s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-b74dc64f-4e9d-4643-b3b3-914556593b98" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-b74dc64f-4e9d-4643-b3b3-914556593b98" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac1e5c7-cf4a-44d5-8c75-b49f96e2cc18]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:14 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98
Sep 11 06:20:14 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:14 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98" returned: 0 in 0.439s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:14 devstack sudo[95458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98
Sep 11 06:20:14 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:15 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b74dc64f-4e9d-4643-b3b3-914556593b98" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-b74dc64f-4e9d-4643-b3b3-914556593b98" released by "delete_volume" :: held 0.845s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['d6f31db6-2818-4c11-9c3b-b41b08a3e5ed'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:15 devstack cinder-volume[88109]: WARNING cinder.quota [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2115549299 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2115549299, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['06b0b36d-0dcf-48a1-ad6d-f780975877f8', '38cc0d52-d0d5-4944-a96d-ff95058370d0', '41f85e86-1a03-45f4-b6bf-f23e322b2f45', 'd1eb7fb7-8446-467f-8d7e-a219d7a347bd'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['da620afc-bb0e-4007-8e67-965a7d54af32', '87514e4a-9d86-49d5-b3be-c79361c83f20', 'ea0e246e-8cdb-476d-988b-8c59314d7618', 'a6d25056-0273-42d0-a848-6fb2376861e6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:15 devstack sudo[95468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:15 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Flow 'volume_create_manager' (141658a2-4093-4488-9c56-8d9e90451573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:16 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1cd736-1fa1-4233-952a-88e11621ade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.582s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-81c1be94-7bb4-42bb-99ba-593678f65714 tempest-GroupSnapshotsTest-173601636 None] Delete group completed successfully.
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1cd736-1fa1-4233-952a-88e11621ade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1183888211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8d38f82a-e6c2-44f1-b4f3-552912ec54cb,host='devstack@QuobyteHD#QuobyteHD',id=d2f0a274-95b1-468f-a0d3-fc899f7a9a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcedef9ea1d477581d5d24414693681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:16Z,use_quota=True,user_id='9315e551ddc04f639d5f1048f38d1e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72dc63d5-4dfc-4245-ade9-580df1b2f2fe),volume_type_id=72dc63d5-4dfc-4245-ade9-580df1b2f2fe)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf2107e-26cc-42f1-bfeb-4eff8bf43e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf2107e-26cc-42f1-bfeb-4eff8bf43e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740e9670-cb58-4601-9fa6-b2f73290785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740e9670-cb58-4601-9fa6-b2f73290785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f0a274-95b1-468f-a0d3-fc899f7a9a58', 'volume_name': 'volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0307eda2-5449-460a-b505-a859fad4adb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0307eda2-5449-460a-b505-a859fad4adb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea739aa4-0f5b-4020-858c-1f5e42bc0907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:16 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Volume d2f0a274-95b1-468f-a0d3-fc899f7a9a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58', 'volume_size': 1}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8d38f82a-e6c2-44f1-b4f3-552912ec54cb,created_at=2026-09-11T04:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1183888211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8d38f82a-e6c2-44f1-b4f3-552912ec54cb,host='devstack@QuobyteHD#QuobyteHD',id=d2f0a274-95b1-468f-a0d3-fc899f7a9a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcedef9ea1d477581d5d24414693681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:16Z,use_quota=True,user_id='9315e551ddc04f639d5f1048f38d1e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72dc63d5-4dfc-4245-ade9-580df1b2f2fe),volume_type_id=72dc63d5-4dfc-4245-ade9-580df1b2f2fe)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Creating volume d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:20:16 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:20:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:16 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 1073741824
Sep 11 06:20:16 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:17 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 1073741824" returned: 0 in 0.584s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:17 devstack sudo[95477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58
Sep 11 06:20:17 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5cc99efd-6ef9-4723-a44b-bd757bd53be1 tempest-GroupSnapshotsTest-173601636 None] Group tempest-GroupSnapshotsTest-Group-802939455: creating
Sep 11 06:20:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5cc99efd-6ef9-4723-a44b-bd757bd53be1 tempest-GroupSnapshotsTest-173601636 None] Group tempest-GroupSnapshotsTest-Group-802939455: created successfully
Sep 11 06:20:17 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" returned: 0 in 0.442s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5cc99efd-6ef9-4723-a44b-bd757bd53be1 tempest-GroupSnapshotsTest-173601636 None] Create group completed successfully.
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea739aa4-0f5b-4020-858c-1f5e42bc0907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d2cd70-bcf8-4d5b-81a1-c9c4cc3aa97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Volume volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 (d2f0a274-95b1-468f-a0d3-fc899f7a9a58): created successfully
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d2cd70-bcf8-4d5b-81a1-c9c4cc3aa97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Flow 'volume_create_manager' (141658a2-4093-4488-9c56-8d9e90451573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b6ed02f7-11bb-402c-8c68-ca26eb27db7e tempest-GroupSnapshotsV319Test-1088418156 None] Created volume successfully.
Sep 11 06:20:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] GroupSnapshot fb8bf7f9-3a54-4651-b5c3-2b4c957bb766: creating.
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Group snapshot fb8bf7f9-3a54-4651-b5c3-2b4c957bb766: creating. {{(pid=88109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Creating offline snapshot 35244615-2bf5-499d-bec9-be770933d43b of volume d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6233301-5637-471e-a0a9-b89636c8c139]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (2416ba0f-145a-4125-a022-f6468050a1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896a0801-2216-4ecc-89f4-a22279d4dfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896a0801-2216-4ecc-89f4-a22279d4dfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830498567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ee6e3d4e-02b2-4b2d-b7b5-fe3053f5de96,host='devstack@QuobyteHD#QuobyteHD',id=fc017ea8-2c27-4db6-a0fe-d13792c7de0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:19Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e92352c-7fad-4101-9fa0-cda8275d45e1),volume_type_id=4e92352c-7fad-4101-9fa0-cda8275d45e1)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f320dc-a1cb-466a-999e-5ba845383308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:19 devstack sudo[95481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f320dc-a1cb-466a-999e-5ba845383308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:19 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0917ff-2f24-4f5c-982f-e979b0dcba7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0917ff-2f24-4f5c-982f-e979b0dcba7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc017ea8-2c27-4db6-a0fe-d13792c7de0c', 'volume_name': 'volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c98f88e-8585-43b6-8887-737e1f8f5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c98f88e-8585-43b6-8887-737e1f8f5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878eb56f-06b4-4f42-8225-515ce0c320a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:19 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Volume fc017ea8-2c27-4db6-a0fe-d13792c7de0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c', 'volume_size': 1}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:19 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" returned: 0 in 0.422s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:19 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b 1G
Sep 11 06:20:19 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:20 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b 1G" returned: 0 in 0.493s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:20 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b
Sep 11 06:20:20 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:20 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b" returned: 0 in 0.357s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:20 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:20 devstack sudo[95499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b
Sep 11 06:20:20 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:20 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b" returned: 0 in 0.314s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:21 devstack sudo[95509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.info
Sep 11 06:20:21 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.info" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:21 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:21 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:21 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.info
Sep 11 06:20:21 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:21 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.info" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.209s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ee6e3d4e-02b2-4b2d-b7b5-fe3053f5de96,created_at=2026-09-11T04:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830498567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ee6e3d4e-02b2-4b2d-b7b5-fe3053f5de96,host='devstack@QuobyteHD#QuobyteHD',id=fc017ea8-2c27-4db6-a0fe-d13792c7de0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c4981e72b40b49f5e9d4074f9fda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:19Z,use_quota=True,user_id='5a2d7fc5cb0548e3bc3cf5fd0a24c744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e92352c-7fad-4101-9fa0-cda8275d45e1),volume_type_id=4e92352c-7fad-4101-9fa0-cda8275d45e1)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Creating volume fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:20:21 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:20:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:21 devstack sudo[95544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c 1073741824
Sep 11 06:20:21 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f41fd28a-a6e3-48e3-a6df-ef89b8eaba1f tempest-GroupSnapshotsV319Test-1088418156 None] group_snapshot fb8bf7f9-3a54-4651-b5c3-2b4c957bb766: created successfully
Sep 11 06:20:22 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c 1073741824" returned: 0 in 0.516s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:22 devstack sudo[95557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c
Sep 11 06:20:22 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:22 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" returned: 0 in 0.256s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878eb56f-06b4-4f42-8225-515ce0c320a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ba00e9-42dd-4372-9538-58f37094689d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:22 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Volume volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c (fc017ea8-2c27-4db6-a0fe-d13792c7de0c): created successfully
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ba00e9-42dd-4372-9538-58f37094689d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Flow 'volume_create_manager' (2416ba0f-145a-4125-a022-f6468050a1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:22 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6743a2ea-6cae-4d1e-80c2-8ae994ddedfc tempest-GroupSnapshotsTest-173601636 None] Created volume successfully.
Sep 11 06:20:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] group_snapshot fb8bf7f9-3a54-4651-b5c3-2b4c957bb766: deleting
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] group_snapshot fb8bf7f9-3a54-4651-b5c3-2b4c957bb766: deleting {{(pid=88109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Acquiring lock "cinder-quobyte-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Lock "cinder-quobyte-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Acquiring lock "cinder-quobyte-35244615-2bf5-499d-bec9-be770933d43b" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Lock "cinder-quobyte-35244615-2bf5-499d-bec9-be770933d43b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Deleting offline snapshot 35244615-2bf5-499d-bec9-be770933d43b of volume d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] snapshot_file for this snap is: volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ea1ff-90dd-4e55-a9bd-6b30121e99ac]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] GroupSnapshot 09e01c5e-d18b-4f5f-a12d-95016ce1261b: creating.
Sep 11 06:20:23 devstack sudo[95589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b
Sep 11 06:20:23 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Group snapshot 09e01c5e-d18b-4f5f-a12d-95016ce1261b: creating. {{(pid=88109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Creating offline snapshot c71f71ee-5845-4a73-ad3c-253c7417f456 of volume fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f689a2b-3609-4791-be8c-f7276d02fb4f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:23 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c
Sep 11 06:20:23 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:23 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b" returned: 0 in 0.419s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3db9ea-0c0e-4836-adc7-59d6527e3e74]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:23 devstack sudo[95596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58
Sep 11 06:20:23 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:23 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" returned: 0 in 0.432s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:23 devstack sudo[95601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 1G
Sep 11 06:20:23 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-1c9026a4-321f-4d0e-9289-20f74597f3dd req-2f6834f3-16e7-4492-a4ed-64cb533bdcfc tempest-AttachVolumeShelveTestJSON-704949995 None] No connector for attachment b6e243d9-cd39-4e1d-bf9c-83515a2cbc06; skipping storage backend terminate_connection call. {{(pid=88109) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 11 06:20:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-1c9026a4-321f-4d0e-9289-20f74597f3dd req-2f6834f3-16e7-4492-a4ed-64cb533bdcfc tempest-AttachVolumeShelveTestJSON-704949995 None] Deleting attachment b6e243d9-cd39-4e1d-bf9c-83515a2cbc06. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:20:24 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:24 devstack sudo[95609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b
Sep 11 06:20:24 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:24 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 1G" returned: 0 in 0.475s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:24 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456
Sep 11 06:20:24 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:24 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b" returned: 0 in 0.426s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:24 devstack sudo[95618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b
Sep 11 06:20:24 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:24 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456" returned: 0 in 0.395s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:24 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:24 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456
Sep 11 06:20:24 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:24 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58.35244615-2bf5-499d-bec9-be770933d43b" returned: 0 in 0.269s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Lock "cinder-quobyte-35244615-2bf5-499d-bec9-be770933d43b" released by "_delete_snapshot" :: held 1.658s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Lock "cinder-quobyte-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" released by "delete_snapshot" :: held 1.683s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:24 devstack cinder-volume[88109]: WARNING cinder.quota [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1847633621 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1847633621, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:24 devstack cinder-volume[88109]: WARNING cinder.quota [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1847633621 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1847633621, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] Created reservations ['293e0e26-0bfc-496c-a8bf-c4ac023a89ca', '7e2bb7da-5efa-4be9-a7b5-51b65a0cd5a9', 'b4b9f923-8d68-4854-add0-e110e92a68d6', 'eec99a31-d85f-4a8b-b437-7817ed1566b1'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:24 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456" returned: 0 in 0.284s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:24 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0bd72539-33d1-4d1e-9298-fca55bb78b2d tempest-GroupSnapshotsV319Test-1088418156 None] group_snapshot fb8bf7f9-3a54-4651-b5c3-2b4c957bb766: deleted successfully
Sep 11 06:20:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:24 devstack sudo[95629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.info
Sep 11 06:20:24 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:25 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.info" returned: 0 in 0.253s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:25 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:25 devstack sudo[95632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.info
Sep 11 06:20:25 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:25 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.info" returned: 0 in 0.298s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-10e20ce4-48e2-48cf-bef1-6c57f623f554 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 09e01c5e-d18b-4f5f-a12d-95016ce1261b: created successfully
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Acquiring lock "cinder-quobyte-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Lock "cinder-quobyte-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8652176-8f96-4a9e-a793-8603c4132027]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:25 devstack sudo[95635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58
Sep 11 06:20:25 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:26 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:26 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58
Sep 11 06:20:26 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:26 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" returned: 0 in 0.257s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Lock "cinder-quobyte-d2f0a274-95b1-468f-a0d3-fc899f7a9a58" released by "delete_volume" :: held 0.765s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Created reservations ['2983877f-0647-4033-83bc-35350836a94c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:26 devstack cinder-volume[88109]: WARNING cinder.quota [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1847633621 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1847633621, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Created reservations ['392b9195-a32c-47e3-b22c-0afd5e084478', 'deb87af2-2a3a-44e1-be3c-852792f53a49', '5c8f245b-3bc6-48fd-8c07-372c2b0bae71', '405d957d-0d43-4ea0-93f9-9d8d6cc7b568'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 09e01c5e-d18b-4f5f-a12d-95016ce1261b: deleting
Sep 11 06:20:26 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:26 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 09e01c5e-d18b-4f5f-a12d-95016ce1261b: deleting {{(pid=88109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-c71f71ee-5845-4a73-ad3c-253c7417f456" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-c71f71ee-5845-4a73-ad3c-253c7417f456" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Deleting offline snapshot c71f71ee-5845-4a73-ad3c-253c7417f456 of volume fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] snapshot_file for this snap is: volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ab502-0346-433a-929a-fcb02989a4df]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:27 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:27 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-99d1e51a-65a8-4003-8014-65f33a6b81cb tempest-GroupSnapshotsV319Test-1088418156 None] Delete group completed successfully.
Sep 11 06:20:27 devstack sudo[95645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456
Sep 11 06:20:27 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:27 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456" returned: 0 in 0.549s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ffcdce-49d8-40b6-9fc4-5b67b172c397]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:27 devstack sudo[95652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c
Sep 11 06:20:27 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:27 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" returned: 0 in 0.472s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:28 devstack sudo[95658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456
Sep 11 06:20:28 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:28 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456" returned: 0 in 0.607s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:28 devstack sudo[95663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456
Sep 11 06:20:28 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:29 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c.c71f71ee-5845-4a73-ad3c-253c7417f456" returned: 0 in 0.471s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-c71f71ee-5845-4a73-ad3c-253c7417f456" released by "_delete_snapshot" :: held 2.238s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" released by "delete_snapshot" :: held 2.277s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:29 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1832455939 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1832455939, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:29 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1832455939 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1832455939, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:29 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] Created reservations ['95a45776-f2ad-4c27-841f-511a6eb26bba', 'a1655b66-1fc9-45d0-990a-92260b6cc775', '4ec9f33e-dc76-4895-a98d-f78355c84295', 'df0315fb-4398-491f-ba0a-49c86b117f81'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7d9ac2ab-420f-4c65-a214-ba3ea976b3e0 tempest-GroupSnapshotsTest-173601636 None] group_snapshot 09e01c5e-d18b-4f5f-a12d-95016ce1261b: deleted successfully
Sep 11 06:20:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "cinder-quobyte-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" acquired by "delete_volume" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:30 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e356935-04ca-4c0e-a1ef-960e7eb2c9ec]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:30 devstack sudo[95680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c
Sep 11 06:20:30 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:31 devstack sudo[95695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:31 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:31 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" returned: 0 in 0.465s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:31 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c
Sep 11 06:20:31 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:31 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.354s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:20:31 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" returned: 0 in 0.361s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Lock "cinder-quobyte-fc017ea8-2c27-4db6-a0fe-d13792c7de0c" released by "delete_volume" :: held 0.886s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Created reservations ['55b3f38d-5523-4e4c-b77e-703578084dd6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:31 devstack cinder-volume[88109]: WARNING cinder.quota [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1832455939 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1832455939, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Created reservations ['80e6de8e-994c-4886-b879-c8ff7e5281f9', '6378c533-2976-4d90-8a4e-f31f37738057', '29bb82da-65cd-4b4a-9570-6d03c951e293', '3f236c60-738a-4364-bb9a-87f87de4a6e1'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:31 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:31 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:32 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:32 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:32 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-390284c3-c966-413b-b566-d564841fbddf tempest-GroupSnapshotsTest-173601636 None] Delete group completed successfully.
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Flow 'volume_create_manager' (755449f4-0f7b-40cc-9d1e-dd0f9e1b19f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbd583b-01c1-4437-a0cd-c62b1111d1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbd583b-01c1-4437-a0cd-c62b1111d1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1718669271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17406bd0-2f60-4923-a639-6812ba3589c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433a144315d545e98012d7624ea1e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:34Z,use_quota=True,user_id='f9b03aca2630423287650a93b45f70a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e163995-de61-4e88-ac76-c98202fd6c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e163995-de61-4e88-ac76-c98202fd6c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b833cf60-8f9c-4b67-bcfa-b9589f564cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b833cf60-8f9c-4b67-bcfa-b9589f564cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17406bd0-2f60-4923-a639-6812ba3589c9', 'volume_name': 'volume-17406bd0-2f60-4923-a639-6812ba3589c9', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7274187-0a2f-4482-832a-f216892f32c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7274187-0a2f-4482-832a-f216892f32c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4dadad-049d-4cea-a51a-12242672262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:33 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Volume 17406bd0-2f60-4923-a639-6812ba3589c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17406bd0-2f60-4923-a639-6812ba3589c9', 'volume_size': 1}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1718669271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17406bd0-2f60-4923-a639-6812ba3589c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='433a144315d545e98012d7624ea1e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:34Z,use_quota=True,user_id='f9b03aca2630423287650a93b45f70a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Creating volume 17406bd0-2f60-4923-a639-6812ba3589c9 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:20:33 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:20:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:34 devstack sudo[95741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9 1073741824
Sep 11 06:20:34 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:34 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9 1073741824" returned: 0 in 0.854s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:34 devstack sudo[95790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9
Sep 11 06:20:34 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:35 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:20:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4dadad-049d-4cea-a51a-12242672262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17406bd0-2f60-4923-a639-6812ba3589c9', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810bdb61-0085-4030-9f13-0426bb14e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:35 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Volume volume-17406bd0-2f60-4923-a639-6812ba3589c9 (17406bd0-2f60-4923-a639-6812ba3589c9): created successfully
Sep 11 06:20:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810bdb61-0085-4030-9f13-0426bb14e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Flow 'volume_create_manager' (755449f4-0f7b-40cc-9d1e-dd0f9e1b19f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fd0d1801-b44b-4a28-943d-3c6579f21044 tempest-AttachVolumeNegativeTest-1276398235 None] Created volume successfully.
Sep 11 06:20:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f8fe6afd-b322-4638-9a8b-84582f741cab req-812e655c-9fb3-4acc-9226-31a723d3322d tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f8fe6afd-b322-4638-9a8b-84582f741cab req-812e655c-9fb3-4acc-9226-31a723d3322d tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f8fe6afd-b322-4638-9a8b-84582f741cab req-812e655c-9fb3-4acc-9226-31a723d3322d tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f8fe6afd-b322-4638-9a8b-84582f741cab req-812e655c-9fb3-4acc-9226-31a723d3322d tempest-AttachVolumeNegativeTest-1276398235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-17406bd0-2f60-4923-a639-6812ba3589c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31881757-9b12-4456-ad9c-617de86b67f1', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:20:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-f8fe6afd-b322-4638-9a8b-84582f741cab req-812e655c-9fb3-4acc-9226-31a723d3322d tempest-AttachVolumeNegativeTest-1276398235 None] attachment_update completed successfully.
Sep 11 06:20:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-a1418951-4cef-4c60-aba9-87c0cda17605 req-f87128d5-cd25-4028-8282-885d04b16ca4 tempest-AttachVolumeNegativeTest-1276398235 None] Terminate volume connection completed successfully.
Sep 11 06:20:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-a1418951-4cef-4c60-aba9-87c0cda17605 req-f87128d5-cd25-4028-8282-885d04b16ca4 tempest-AttachVolumeNegativeTest-1276398235 None] Deleting attachment 31881757-9b12-4456-ad9c-617de86b67f1. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:20:42 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=146,cinder:INSERT=36,cinder:UPDATE=156,cinder:DELETE=6 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:20:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d741ba43-ac05-4b22-97cb-0af50aa322dc tempest-GroupsV320Test-1840145857 None] Group tempest-GroupsV320Test-Group-1865715819: creating
Sep 11 06:20:42 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=140,cinder:UPDATE=129,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:20:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d741ba43-ac05-4b22-97cb-0af50aa322dc tempest-GroupsV320Test-1840145857 None] Group tempest-GroupsV320Test-Group-1865715819: created successfully
Sep 11 06:20:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d741ba43-ac05-4b22-97cb-0af50aa322dc tempest-GroupsV320Test-1840145857 None] Create group completed successfully.
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Created reservations ['a7a5766e-0bd7-4edd-adf1-e4634aefd3f0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:44 devstack sudo[96249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:44 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:44 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:44 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:44 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f5d187e9-d9ab-4fdf-b20c-46605bb1cd37 tempest-GroupsV320Test-1840145857 None] Delete group completed successfully.
Sep 11 06:20:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-77388f02-dc4e-40e3-8b07-3c79e55056fb tempest-GroupsV314Test-1449037559 None] Group tempest-GroupsV314Test-Group-1658851206: creating
Sep 11 06:20:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-77388f02-dc4e-40e3-8b07-3c79e55056fb tempest-GroupsV314Test-1449037559 None] Group tempest-GroupsV314Test-Group-1658851206: created successfully
Sep 11 06:20:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-77388f02-dc4e-40e3-8b07-3c79e55056fb tempest-GroupsV314Test-1449037559 None] Create group completed successfully.
Sep 11 06:20:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "cinder-17406bd0-2f60-4923-a639-6812ba3589c9-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-17406bd0-2f60-4923-a639-6812ba3589c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "cinder-quobyte-17406bd0-2f60-4923-a639-6812ba3589c9" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-quobyte-17406bd0-2f60-4923-a639-6812ba3589c9" acquired by "delete_volume" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:47 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe3258-e53e-4418-87e5-e7b077c28ec5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:47 devstack sudo[96261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9
Sep 11 06:20:47 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:47 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9" returned: 0 in 0.657s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:47 devstack sudo[96267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9
Sep 11 06:20:47 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Flow 'volume_create_manager' (cbad8bff-6b2a-4008-bc9a-ae31fa3a60c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf3091e-bb6f-4b9b-96b2-86227a809cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf3091e-bb6f-4b9b-96b2-86227a809cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606228652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8bae98e-dfaa-42aa-9b10-d08f0d645962,host='devstack@QuobyteHD#QuobyteHD',id=2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33f39514496424b8c2fc03985d137fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:48Z,use_quota=True,user_id='3385d025d3394150a71f0059e14ed376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bfc1be6-c62e-4bdc-9032-1d4e24d23328),volume_type_id=9bfc1be6-c62e-4bdc-9032-1d4e24d23328)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de7bdfa-ab7f-4420-8987-791855b50a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de7bdfa-ab7f-4420-8987-791855b50a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f65faec-a3f0-445b-a26b-2344bc71a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:48 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f65faec-a3f0-445b-a26b-2344bc71a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b', 'volume_name': 'volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759bc90e-f6c0-4e90-b7c0-9fca557ffcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759bc90e-f6c0-4e90-b7c0-9fca557ffcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f12aa6-9ddd-41e3-bf27-a43d64924d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:48 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Volume 2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b', 'volume_size': 1}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b8bae98e-dfaa-42aa-9b10-d08f0d645962,created_at=2026-09-11T04:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606228652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8bae98e-dfaa-42aa-9b10-d08f0d645962,host='devstack@QuobyteHD#QuobyteHD',id=2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33f39514496424b8c2fc03985d137fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:48Z,use_quota=True,user_id='3385d025d3394150a71f0059e14ed376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bfc1be6-c62e-4bdc-9032-1d4e24d23328),volume_type_id=9bfc1be6-c62e-4bdc-9032-1d4e24d23328)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Creating volume 2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:20:48 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-17406bd0-2f60-4923-a639-6812ba3589c9" returned: 0 in 0.477s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-quobyte-17406bd0-2f60-4923-a639-6812ba3589c9" released by "delete_volume" :: held 1.204s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:48 devstack sudo[96270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b 1073741824
Sep 11 06:20:48 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Created reservations ['57de3375-5209-45b7-987f-740cdf329ef0', '1166d6f7-f0fb-4a8e-b02a-ced764061213', 'b60284e2-d34f-42e2-ba84-7e4fdf7d57fd', '334d66a0-a174-4f1b-a517-b7e3a65c0900'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:48 devstack sudo[96273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:48 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:48 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.300s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Deleted volume successfully.
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-732a58db-d5ef-43a9-8f1d-21c5288a57a2 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-17406bd0-2f60-4923-a639-6812ba3589c9-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:48 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b 1073741824" returned: 0 in 0.683s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:48 devstack sudo[96279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b
Sep 11 06:20:48 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:49 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" returned: 0 in 0.295s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f12aa6-9ddd-41e3-bf27-a43d64924d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bac088c-db88-44ad-b468-023ad9707414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Volume volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b (2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b): created successfully
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bac088c-db88-44ad-b468-023ad9707414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Flow 'volume_create_manager' (cbad8bff-6b2a-4008-bc9a-ae31fa3a60c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "cinder-c543fb30-f828-454c-8e24-ab8401848cd8-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:49 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-369e8a99-83a7-4c9d-8691-f0ab2504fbf1 tempest-GroupsV314Test-1449037559 None] Created volume successfully.
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-c543fb30-f828-454c-8e24-ab8401848cd8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "cinder-quobyte-c543fb30-f828-454c-8e24-ab8401848cd8" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-quobyte-c543fb30-f828-454c-8e24-ab8401848cd8" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e06570-705e-438c-9aa5-c62920422a53]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:49 devstack sudo[96282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8
Sep 11 06:20:49 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:49 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8" returned: 0 in 0.376s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:49 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8
Sep 11 06:20:49 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:50 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c543fb30-f828-454c-8e24-ab8401848cd8" returned: 0 in 0.249s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-quobyte-c543fb30-f828-454c-8e24-ab8401848cd8" released by "delete_volume" :: held 0.680s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Created reservations ['514bdbb0-03c1-4f95-80e0-6cab446492e9', 'b58620be-0967-4124-a85d-9f99549a7467', 'dd148717-341e-4c9e-8466-ab79c6501d35', '8f345189-fbae-4953-ac15-3f696a6c823c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:50 devstack sudo[96290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:50 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:50 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.274s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:50 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Deleted volume successfully.
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bb589939-a1c2-4e88-9145-0b298ace5a91 tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-c543fb30-f828-454c-8e24-ab8401848cd8-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "cinder-82305559-4399-454b-9125-a44fda3ac601-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-82305559-4399-454b-9125-a44fda3ac601-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "cinder-quobyte-82305559-4399-454b-9125-a44fda3ac601" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-quobyte-82305559-4399-454b-9125-a44fda3ac601" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b728a635-6b18-4e4e-aec0-bbd61336385c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:50 devstack sudo[96293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601
Sep 11 06:20:50 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:51 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Cloning volume 2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b to volume 637cabf3-1634-441b-bdea-d2d2147901a1
Sep 11 06:20:51 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Creating offline snapshot dad0b786-6602-4134-9014-84d148ece785 of volume 2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601" returned: 0 in 0.437s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2300635c-f26f-4d23-b948-c8e398e9aad8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:51 devstack sudo[96298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601
Sep 11 06:20:51 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:51 devstack sudo[96299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b
Sep 11 06:20:51 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:51 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-82305559-4399-454b-9125-a44fda3ac601" returned: 0 in 0.360s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-quobyte-82305559-4399-454b-9125-a44fda3ac601" released by "delete_volume" :: held 0.842s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Created reservations ['fcecacce-4be4-4acb-bad7-6336360062d3', '1d218f4c-3e39-4e29-9e05-476e3edc1450', '2d495738-d3fc-45da-a9dc-88755bd66b70', '421679b7-4f21-4da8-b985-6134116949ae'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:20:51 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" returned: 0 in 0.456s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:51 devstack sudo[96306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 1G
Sep 11 06:20:51 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:51 devstack sudo[96308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:20:51 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:52 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.313s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:20:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Deleted volume successfully.
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78606408-8770-4f7f-a5a6-3421655238ed tempest-AttachVolumeNegativeTest-1276398235 None] Lock "cinder-82305559-4399-454b-9125-a44fda3ac601-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:20:52 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 1G" returned: 0 in 0.516s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:52 devstack sudo[96315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785
Sep 11 06:20:52 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:52 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785" returned: 0 in 0.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:52 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:52 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785
Sep 11 06:20:52 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:52 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785" returned: 0 in 0.378s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:52 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.info
Sep 11 06:20:52 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Flow 'volume_create_manager' (c9c00aab-1e1f-463a-88cd-fa8de3a69500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa53007e-e9c2-468f-bcf2-30995851c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa53007e-e9c2-468f-bcf2-30995851c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2147172839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26604de1-0636-40bb-9a7d-eab6052d4f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3b590e264e4ab69db76ccfbae85bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:53Z,use_quota=True,user_id='8c9d1d647cd04d07a045d91f641b462b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28818efe-d2ed-470a-af30-d4f8e128c401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28818efe-d2ed-470a-af30-d4f8e128c401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b3d230-b730-479d-a125-906da5967028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b3d230-b730-479d-a125-906da5967028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26604de1-0636-40bb-9a7d-eab6052d4f5f', 'volume_name': 'volume-26604de1-0636-40bb-9a7d-eab6052d4f5f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a915e151-d134-4613-ba8d-438cffb8abe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a915e151-d134-4613-ba8d-438cffb8abe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79581e3-7025-4730-8c7a-c0c087d3ec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:20:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Volume 26604de1-0636-40bb-9a7d-eab6052d4f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26604de1-0636-40bb-9a7d-eab6052d4f5f', 'volume_size': 1}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:53 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.info" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:53 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:53 devstack sudo[96326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.info
Sep 11 06:20:53 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:53 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.info" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Acquiring lock "cinder-quobyte-637cabf3-1634-441b-bdea-d2d2147901a1" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-637cabf3-1634-441b-bdea-d2d2147901a1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] snapshot: dad0b786-6602-4134-9014-84d148ece785, volume: 637cabf3-1634-441b-bdea-d2d2147901a1,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc73e66d-15b2-40b2-818e-8c6b47117b84]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:53 devstack sudo[96330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785
Sep 11 06:20:53 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:53 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785" returned: 0 in 0.403s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c78716-10e1-4428-85cc-0b658a2861a9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:20:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:54 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b
Sep 11 06:20:54 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:20:54 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Sep 11 06:20:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" returned: 0 in 0.375s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:20:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:20:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:20:54 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:20:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:20:54 devstack sudo[96340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1
Sep 11 06:20:54 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:00 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1" returned: 0 in 6.337s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:00 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:21:00 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Converted 1024.00 MB image at 161.55 MB/s
Sep 11 06:21:00 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 06:21:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:00 devstack sudo[96381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1
Sep 11 06:21:00 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:01 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1" returned: 0 in 0.332s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-637cabf3-1634-441b-bdea-d2d2147901a1" released by "_copy_volume_from_snapshot" :: held 7.547s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Acquiring lock "cinder-quobyte-dad0b786-6602-4134-9014-84d148ece785" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-dad0b786-6602-4134-9014-84d148ece785" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Deleting offline snapshot dad0b786-6602-4134-9014-84d148ece785 of volume 2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] snapshot_file for this snap is: volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4011afbc-4556-4529-b3a2-0cda308bbca6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:01 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785
Sep 11 06:21:01 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:01 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785" returned: 0 in 0.488s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[413ff011-11d4-426e-a38d-540e434ed669]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:01 devstack sudo[96391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b
Sep 11 06:21:01 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:02 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" returned: 0 in 0.600s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:02 devstack sudo[96396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785
Sep 11 06:21:02 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:02 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785" returned: 0 in 0.353s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:02 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785
Sep 11 06:21:02 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:02 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b.dad0b786-6602-4134-9014-84d148ece785" returned: 0 in 0.296s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-dad0b786-6602-4134-9014-84d148ece785" released by "_delete_snapshot" :: held 1.879s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.832s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.880s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2147172839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26604de1-0636-40bb-9a7d-eab6052d4f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3b590e264e4ab69db76ccfbae85bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:20:53Z,use_quota=True,user_id='8c9d1d647cd04d07a045d91f641b462b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Creating volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:03 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:03 devstack sudo[96405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f 1073741824
Sep 11 06:21:03 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f800035d-b210-432b-9df6-4079b2324c79 tempest-GroupsV314Test-1449037559 None] Create group from source-group-b8bae98e-dfaa-42aa-9b10-d08f0d645962 completed successfully.
Sep 11 06:21:03 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f 1073741824" returned: 0 in 0.586s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:03 devstack sudo[96412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f
Sep 11 06:21:03 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Acquiring lock "cinder-564f78de-abfe-4bf0-91aa-b8c4f6376b96-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "cinder-564f78de-abfe-4bf0-91aa-b8c4f6376b96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Acquiring lock "cinder-quobyte-564f78de-abfe-4bf0-91aa-b8c4f6376b96" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "cinder-quobyte-564f78de-abfe-4bf0-91aa-b8c4f6376b96" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2816fe76-35be-49a9-84fc-8ccffde4cbff]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:03 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f" returned: 0 in 0.343s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79581e3-7025-4730-8c7a-c0c087d3ec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26604de1-0636-40bb-9a7d-eab6052d4f5f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cba5146-2229-4e17-993d-4dd89a05bf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Volume volume-26604de1-0636-40bb-9a7d-eab6052d4f5f (26604de1-0636-40bb-9a7d-eab6052d4f5f): created successfully
Sep 11 06:21:04 devstack sudo[96414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cba5146-2229-4e17-993d-4dd89a05bf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:04 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Flow 'volume_create_manager' (c9c00aab-1e1f-463a-88cd-fa8de3a69500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-81bd91ff-9b21-4407-b4d4-3dc256b7744c tempest-SnapshotsActionsTest-2078996601 None] Created volume successfully.
Sep 11 06:21:04 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96" returned: 0 in 0.480s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:04 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96
Sep 11 06:21:04 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Creating offline snapshot 8ad4a177-d11c-46d4-a2c9-6913586d06e7 of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e1b59-68c7-4d73-be47-1d17e19f1bf7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:04 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f
Sep 11 06:21:04 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:04 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-564f78de-abfe-4bf0-91aa-b8c4f6376b96" returned: 0 in 0.371s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Acquiring lock "cinder-quobyte-637cabf3-1634-441b-bdea-d2d2147901a1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "cinder-quobyte-564f78de-abfe-4bf0-91aa-b8c4f6376b96" released by "delete_volume" :: held 0.910s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-637cabf3-1634-441b-bdea-d2d2147901a1" acquired by "delete_volume" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dac194-4162-479a-a894-b54f220a589c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:04 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Created reservations ['4b062c1b-0988-4cad-95c9-70ba3ab0e7b1', '3a7851e8-137c-4c65-ab91-f01a887da6df', '8c05b6ca-8488-4ef5-812f-ca5d896cd14b', '30d144b4-4239-4a4b-bf2c-17ff02eb39b7'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:05 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:05 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:05 devstack sudo[96425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1
Sep 11 06:21:05 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:05 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f" returned: 0 in 0.553s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:05 devstack sudo[96432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 1G
Sep 11 06:21:05 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:05 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.313s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Deleted volume successfully.
Sep 11 06:21:05 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-566678b6-24f6-4df3-9998-2e7cd0b3b255 tempest-AttachVolumeShelveTestJSON-704949995 None] Lock "cinder-564f78de-abfe-4bf0-91aa-b8c4f6376b96-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1" returned: 0 in 0.555s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:05 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1
Sep 11 06:21:05 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:05 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 1G" returned: 0 in 0.541s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:05 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:05 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:05 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-637cabf3-1634-441b-bdea-d2d2147901a1" returned: 0 in 0.331s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-637cabf3-1634-441b-bdea-d2d2147901a1" released by "delete_volume" :: held 0.950s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Created reservations ['44b73285-c9d1-405f-a4bd-1f0f5770a415'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:05 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1148885047 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1148885047, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:05 devstack cinder-volume[88109]: WARNING cinder.quota [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1148885047 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1148885047, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Created reservations ['24d3c59f-e86d-4eec-a282-bd3b2fe7564c', '6351a53b-1da5-488e-83fc-e54af277e978', '37cd7342-4e84-496c-98fc-7b272734bc66', '46eb53b2-5b99-4d15-8dd4-763f86a1adb6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:06 devstack sudo[96450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:06 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:06 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.409s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:06 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 is being set with open permissions: ugo+rw
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:06 devstack sudo[96452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:06 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Acquiring lock "cinder-quobyte-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:06 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.379s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:06 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747f5cd-d2e3-428c-8979-d97514a08b78]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.502s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7003c2d2-c06b-4753-93ab-6e515a8e0375 tempest-GroupsV314Test-1449037559 None] Delete group completed successfully.
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:06 devstack sudo[96457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.info
Sep 11 06:21:06 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:06 devstack sudo[96456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b
Sep 11 06:21:06 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:06 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.info" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:06 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.info is being set with open permissions: ugo+rw
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:06 devstack sudo[96463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.info
Sep 11 06:21:06 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:06 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" returned: 0 in 0.510s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:07 devstack sudo[96466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b
Sep 11 06:21:07 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:07 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.info" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.749s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:07 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" returned: 0 in 0.312s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-334842dc-8382-4f10-a8ff-7a2c1033ff8d tempest-SnapshotsActionsTest-2078996601 None] Create snapshot completed successfully
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Lock "cinder-quobyte-2a7ba6fc-0e8a-4dca-ad7c-b55c9fde900b" released by "delete_volume" :: held 0.909s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Created reservations ['6a213f18-5e58-4d60-91de-0202c59fb770'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Created reservations ['6a16ea7d-177d-476e-bc64-87c0f09492d2', '9d573c58-71c7-469d-a7d3-5b654633e584', 'e39cc507-700b-4e1f-aaa7-3fffd00d0efc', 'bd7b2349-7b40-408f-a626-02f3210c39a2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:07 devstack sudo[96471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:07 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:07 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.320s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:07 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ff34479e-ae07-4928-a4fa-1f52be136af6 tempest-GroupsV314Test-1449037559 None] Delete group completed successfully.
Sep 11 06:21:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Creating offline snapshot 46d3b261-edfc-4d08-8485-23aa0715ddb0 of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:21:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[294608eb-8c1c-4d68-988a-285979d60ed9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:08 devstack sudo[96475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:08 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:09 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.457s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:09 devstack sudo[96481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 1G
Sep 11 06:21:09 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:09 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 1G" returned: 0 in 0.674s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:09 devstack sudo[96487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0
Sep 11 06:21:09 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:10 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:10 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 is being set with open permissions: ugo+rw
Sep 11 06:21:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:10 devstack sudo[96492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0
Sep 11 06:21:10 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:10 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0" returned: 0 in 0.309s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-860f621f-9409-4b83-8398-efc4c74518c1 tempest-SnapshotsActionsTest-2078996601 None] Create snapshot completed successfully
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Flow 'volume_create_manager' (16314286-d7c1-42d4-8332-d247160894a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec3628b-1cc7-4565-bac7-ab8bd2158fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-46d3b261-edfc-4d08-8485-23aa0715ddb0-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec3628b-1cc7-4565-bac7-ab8bd2158fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-13225340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711147b7-9cd5-4395-9ae1-2d1900892ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b233d21e41eb428b88b5e1176ce3eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:11Z,use_quota=True,user_id='b48648536b7e4c8a9303e9092c50f951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0618b33-297d-4990-8281-ad882509c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0618b33-297d-4990-8281-ad882509c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4e6e6c-b535-4702-8dca-73e18a07ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4e6e6c-b535-4702-8dca-73e18a07ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711147b7-9cd5-4395-9ae1-2d1900892ca0', 'volume_name': 'volume-711147b7-9cd5-4395-9ae1-2d1900892ca0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ba7c9a-d0dc-4ba4-a18d-92cf54fe225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ba7c9a-d0dc-4ba4-a18d-92cf54fe225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4170d1ba-ecf1-40eb-b39d-37ae789a476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:11 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Volume 711147b7-9cd5-4395-9ae1-2d1900892ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711147b7-9cd5-4395-9ae1-2d1900892ca0', 'volume_size': 1}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-13225340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711147b7-9cd5-4395-9ae1-2d1900892ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b233d21e41eb428b88b5e1176ce3eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:11Z,use_quota=True,user_id='b48648536b7e4c8a9303e9092c50f951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Creating volume 711147b7-9cd5-4395-9ae1-2d1900892ca0 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:11 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-46d3b261-edfc-4d08-8485-23aa0715ddb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.132s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:11 devstack sudo[96495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0 1073741824
Sep 11 06:21:11 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-46d3b261-edfc-4d08-8485-23aa0715ddb0" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-46d3b261-edfc-4d08-8485-23aa0715ddb0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Deleting offline snapshot 46d3b261-edfc-4d08-8485-23aa0715ddb0 of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] snapshot_file for this snap is: volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6105e71-5401-4e8a-b6b4-b5b3e04a2a43]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:11 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0
Sep 11 06:21:11 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:11 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0 1073741824" returned: 0 in 0.565s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:11 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0" returned: 0 in 0.475s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1547840-9491-48a4-8689-3b93ba3eee81]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:12 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0
Sep 11 06:21:12 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:12 devstack sudo[96507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:12 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:12 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0" returned: 0 in 0.361s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4170d1ba-ecf1-40eb-b39d-37ae789a476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711147b7-9cd5-4395-9ae1-2d1900892ca0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae5c966-3446-4bf2-8e1c-ba83a2a08c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Volume volume-711147b7-9cd5-4395-9ae1-2d1900892ca0 (711147b7-9cd5-4395-9ae1-2d1900892ca0): created successfully
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae5c966-3446-4bf2-8e1c-ba83a2a08c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Flow 'volume_create_manager' (16314286-d7c1-42d4-8332-d247160894a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fed5d442-9374-4645-b60c-61cadbe6ab93 tempest-VolumeQuotasAdminTestJSON-1225438672 None] Created volume successfully.
Sep 11 06:21:12 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.583s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:12 devstack sudo[96516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0
Sep 11 06:21:12 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:13 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0" returned: 0 in 0.513s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:13 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0
Sep 11 06:21:13 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:13 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.46d3b261-edfc-4d08-8485-23aa0715ddb0" returned: 0 in 0.346s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Acquiring lock "cinder-711147b7-9cd5-4395-9ae1-2d1900892ca0-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-46d3b261-edfc-4d08-8485-23aa0715ddb0" released by "_delete_snapshot" :: held 2.059s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" released by "delete_snapshot" :: held 2.097s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "cinder-711147b7-9cd5-4395-9ae1-2d1900892ca0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Acquiring lock "cinder-quobyte-711147b7-9cd5-4395-9ae1-2d1900892ca0" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Created reservations ['ab6434e2-c172-429d-bf63-d8d59158ab89', 'af2b647c-687a-4192-8208-ffe0f79b8540', '4f7ac891-2b95-4587-83b1-590772c6b115', 'f52bbbdf-0c54-46c5-87f7-755c4925f31d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "cinder-quobyte-711147b7-9cd5-4395-9ae1-2d1900892ca0" acquired by "delete_volume" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce727a-bba9-4f5e-b397-1403970c0055]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Delete snapshot completed successfully.
Sep 11 06:21:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b0b39bf-6f2d-4aa4-b143-6b46f03b2813 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-46d3b261-edfc-4d08-8485-23aa0715ddb0-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:13 devstack sudo[96525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0
Sep 11 06:21:13 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:14 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0" returned: 0 in 0.425s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:14 devstack sudo[96530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0
Sep 11 06:21:14 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:14 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-711147b7-9cd5-4395-9ae1-2d1900892ca0" returned: 0 in 0.282s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "cinder-quobyte-711147b7-9cd5-4395-9ae1-2d1900892ca0" released by "delete_volume" :: held 0.771s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Created reservations ['af60585a-2e8d-4c25-9571-1a160be83c19', '22217260-0f90-4ac8-b794-9cba7b798798', '394ae175-f82f-4d9f-8318-5d6b2ffa7c5a', 'ea5cf182-7934-4d3b-8470-7497f3e6c9a4'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:14 devstack sudo[96533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:14 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Creating offline snapshot eeb98113-5ac6-4c85-87b1-3c23b927fc0a of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:21:14 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.436s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:15 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Deleted volume successfully.
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d65896-4038-4c28-a082-469d3af739e0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5f24ee2a-8847-4474-8420-e947e1caa66f tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "cinder-711147b7-9cd5-4395-9ae1-2d1900892ca0-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:15 devstack sudo[96536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:15 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Flow 'volume_create_manager' (2ea14e86-13ee-4c91-83de-f3129bd929d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3ec5d0-2475-4c56-b704-80b8617434f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3ec5d0-2475-4c56-b704-80b8617434f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1782990472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846eb7dc-75fa-4e13-a218-501252493de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b233d21e41eb428b88b5e1176ce3eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:15Z,use_quota=True,user_id='b48648536b7e4c8a9303e9092c50f951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50669a8-2e26-44cd-b416-08e8f4782964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50669a8-2e26-44cd-b416-08e8f4782964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da230c3-f493-48cc-8dd2-95b4c016e42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da230c3-f493-48cc-8dd2-95b4c016e42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846eb7dc-75fa-4e13-a218-501252493de9', 'volume_name': 'volume-846eb7dc-75fa-4e13-a218-501252493de9', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6880befb-5b44-45bc-bfdc-0d34fb990b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6880befb-5b44-45bc-bfdc-0d34fb990b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a24613a-1b89-4bd2-aea4-f25b67b5e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:15 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Volume 846eb7dc-75fa-4e13-a218-501252493de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846eb7dc-75fa-4e13-a218-501252493de9', 'volume_size': 1}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:15 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.515s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:15 devstack sudo[96542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a 1G
Sep 11 06:21:15 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:16 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a 1G" returned: 0 in 0.535s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:16 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a
Sep 11 06:21:16 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:16 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a" returned: 0 in 0.398s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:16 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a is being set with open permissions: ugo+rw
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:16 devstack sudo[96554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a
Sep 11 06:21:16 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:16 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a" returned: 0 in 0.275s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1782990472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846eb7dc-75fa-4e13-a218-501252493de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b233d21e41eb428b88b5e1176ce3eed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:15Z,use_quota=True,user_id='b48648536b7e4c8a9303e9092c50f951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Creating volume 846eb7dc-75fa-4e13-a218-501252493de9 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:16 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:16 devstack sudo[96557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9 1073741824
Sep 11 06:21:16 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-bfeb717a-ef8e-4f43-8359-b067ba6480b7 tempest-SnapshotsActionsTest-2078996601 None] Create snapshot completed successfully
Sep 11 06:21:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cf55326e-40e5-470f-9c4c-cbe88ecd997b tempest-BackendsCapabilitiesAdminTestsJSON-157381493 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.230613708496, 'free_capacity_gb': 1773.230613708496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0273cbd5-2572-42ee-aafa-f70352049e8a tempest-BackendsCapabilitiesAdminTestsJSON-157381493 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.230613708496, 'free_capacity_gb': 1773.230613708496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-eeb98113-5ac6-4c85-87b1-3c23b927fc0a-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-eeb98113-5ac6-4c85-87b1-3c23b927fc0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-eeb98113-5ac6-4c85-87b1-3c23b927fc0a" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-eeb98113-5ac6-4c85-87b1-3c23b927fc0a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Deleting offline snapshot eeb98113-5ac6-4c85-87b1-3c23b927fc0a of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] snapshot_file for this snap is: volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88dc52-f77d-492d-b6e3-ff58b96b9797]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:17 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9 1073741824" returned: 0 in 0.582s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:17 devstack sudo[96564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9
Sep 11 06:21:17 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:17 devstack sudo[96563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a
Sep 11 06:21:17 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:17 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9" returned: 0 in 0.323s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:17 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a24613a-1b89-4bd2-aea4-f25b67b5e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846eb7dc-75fa-4e13-a218-501252493de9', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615a1b65-eaf2-46c1-8f17-00dc3ef21964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a" returned: 0 in 0.478s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Volume volume-846eb7dc-75fa-4e13-a218-501252493de9 (846eb7dc-75fa-4e13-a218-501252493de9): created successfully
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615a1b65-eaf2-46c1-8f17-00dc3ef21964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Flow 'volume_create_manager' (2ea14e86-13ee-4c91-83de-f3129bd929d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7540a-c058-4c64-a4af-243457253c70]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8f874536-20c5-432a-9ee7-8e6356acd08c tempest-VolumeQuotasAdminTestJSON-1225438672 None] Created volume successfully.
Sep 11 06:21:18 devstack sudo[96573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:18 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:18 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.387s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:18 devstack sudo[96579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a
Sep 11 06:21:18 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:18 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a" returned: 0 in 0.467s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:18 devstack sudo[96585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a
Sep 11 06:21:18 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:19 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.eeb98113-5ac6-4c85-87b1-3c23b927fc0a" returned: 0 in 0.349s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-eeb98113-5ac6-4c85-87b1-3c23b927fc0a" released by "_delete_snapshot" :: held 1.807s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" released by "delete_snapshot" :: held 1.842s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Created reservations ['640697b0-2abc-4d13-8a4a-11fa7516b804', 'a6dc9498-b722-4df8-8ff1-4b8668304bc3', 'e92e670c-3819-47c4-9cd8-a90d0dc8dff9', '6a266fde-34a1-48d7-b3ce-1771b2cd2cc9'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Delete snapshot completed successfully.
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-638af598-da14-4f95-96df-1b4a4b682a76 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-eeb98113-5ac6-4c85-87b1-3c23b927fc0a-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-01c77dfd-53aa-4ee2-b591-c01f17f58bd0 tempest-VolumeQuotasAdminTestJSON-1377057919 None] Transfer volume completed successfully.
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Creating offline snapshot e03f5493-97e2-4757-8f5e-1596ceecd4a3 of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[058c114f-f61a-49c0-8afc-0a34089438e1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:20 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:20 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Acquiring lock "cinder-846eb7dc-75fa-4e13-a218-501252493de9-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Lock "cinder-846eb7dc-75fa-4e13-a218-501252493de9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Acquiring lock "cinder-quobyte-846eb7dc-75fa-4e13-a218-501252493de9" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Lock "cinder-quobyte-846eb7dc-75fa-4e13-a218-501252493de9" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b615b794-d51e-4728-88b2-279d20859ca6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:20 devstack sudo[96590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9
Sep 11 06:21:20 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:20 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.564s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:20 devstack sudo[96596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 1G
Sep 11 06:21:20 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:20 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9" returned: 0 in 0.462s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:20 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9
Sep 11 06:21:20 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:21 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 1G" returned: 0 in 0.629s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:21 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-846eb7dc-75fa-4e13-a218-501252493de9" returned: 0 in 0.362s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:21 devstack sudo[96608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3
Sep 11 06:21:21 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Lock "cinder-quobyte-846eb7dc-75fa-4e13-a218-501252493de9" released by "delete_volume" :: held 0.890s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Created reservations ['4a77c187-d458-4b43-9d67-f36639848916', '96e77f56-62ec-4fce-8f01-144f02d84b75', 'f4ab4db5-9568-4d6d-9cf7-c815ab5fcd4e', '776a4a4c-ec27-4ca6-afe5-7a7ea96beefc'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:21 devstack sudo[96610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:21 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:21 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3" returned: 0 in 0.408s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:21 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 is being set with open permissions: ugo+rw
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:21 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3
Sep 11 06:21:21 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:21 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.318s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Deleted volume successfully.
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b0de9d73-b9d8-4f56-bb1d-da128a017979 tempest-VolumeQuotasAdminTestJSON-676564968 None] Lock "cinder-846eb7dc-75fa-4e13-a218-501252493de9-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:21 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3" returned: 0 in 0.321s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:22 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0d8f4754-944d-418e-a75e-3ba4058bffdd tempest-SnapshotsActionsTest-2078996601 None] Create snapshot completed successfully
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-e03f5493-97e2-4757-8f5e-1596ceecd4a3-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-e03f5493-97e2-4757-8f5e-1596ceecd4a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-e03f5493-97e2-4757-8f5e-1596ceecd4a3" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-e03f5493-97e2-4757-8f5e-1596ceecd4a3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Deleting offline snapshot e03f5493-97e2-4757-8f5e-1596ceecd4a3 of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] snapshot_file for this snap is: volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[66675931-739d-4324-ae23-ed35f34b037b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:23 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3
Sep 11 06:21:23 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:23 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3" returned: 0 in 0.438s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d2d0eb-db5d-4711-b76b-9786cc1110e9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:24 devstack sudo[96662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:24 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:24 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.404s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:24 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3
Sep 11 06:21:24 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:24 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3" returned: 0 in 0.447s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:24 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3
Sep 11 06:21:24 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:25 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.e03f5493-97e2-4757-8f5e-1596ceecd4a3" returned: 0 in 0.386s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-e03f5493-97e2-4757-8f5e-1596ceecd4a3" released by "_delete_snapshot" :: held 1.805s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" released by "delete_snapshot" :: held 1.843s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Created reservations ['eb26523f-0203-485a-9785-80b7030a6b71', '6ca82457-bc51-4753-865b-451df69c8c16', 'bd461ea4-3d58-4250-a64c-e3b3e4b72292', '9d95099a-56e7-41cd-8c3f-97e1f4d3e6bd'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Delete snapshot completed successfully.
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb8a77fe-9a77-40c7-9c3c-be009f46fc79 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-e03f5493-97e2-4757-8f5e-1596ceecd4a3-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Creating offline snapshot a18aff80-d204-4870-949a-7502d7bbfccf of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:21:26 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16e440e-18e5-4cf1-9eb2-74ee01a9aa19]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:26 devstack sudo[96676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:26 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:26 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.489s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:26 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf 1G
Sep 11 06:21:26 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:27 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf 1G" returned: 0 in 0.604s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:27 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf
Sep 11 06:21:27 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:27 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf" returned: 0 in 0.321s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:27 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf is being set with open permissions: ugo+rw
Sep 11 06:21:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:27 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf
Sep 11 06:21:27 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:27 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf" returned: 0 in 0.272s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:27 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d41d5c77-d13b-426b-94f0-89e4ee25bb38 tempest-SnapshotsActionsTest-2078996601 None] Create snapshot completed successfully
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-a18aff80-d204-4870-949a-7502d7bbfccf-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-a18aff80-d204-4870-949a-7502d7bbfccf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Acquiring lock "cinder-quobyte-a18aff80-d204-4870-949a-7502d7bbfccf" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-a18aff80-d204-4870-949a-7502d7bbfccf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Deleting offline snapshot a18aff80-d204-4870-949a-7502d7bbfccf of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] snapshot_file for this snap is: volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[980d20e2-f00e-423f-ad3b-4c957f1b4ee8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:28 devstack sudo[96697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf
Sep 11 06:21:28 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:28 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece2580-9ed6-49f3-b126-8fbb0127e543]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:28 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:28 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:29 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.432s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:29 devstack sudo[96709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf
Sep 11 06:21:29 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:29 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf" returned: 0 in 0.587s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:29 devstack sudo[96716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf
Sep 11 06:21:29 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:30 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.a18aff80-d204-4870-949a-7502d7bbfccf" returned: 0 in 0.355s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-a18aff80-d204-4870-949a-7502d7bbfccf" released by "_delete_snapshot" :: held 1.946s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" released by "delete_snapshot" :: held 1.978s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:30 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Created reservations ['543032e7-f66f-4288-a2b4-d3c38bdd40cf', '3bb069b9-4e60-4791-99f3-7fd14101ed7a', '55fdddd8-f665-46dc-8550-4382e6113b7c', '39aa6671-b90a-4962-bef6-c518a05c8c22'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:30 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Delete snapshot completed successfully.
Sep 11 06:21:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-610c63dc-e2d9-4b9f-bfc3-5d2919a90886 tempest-SnapshotsActionsTest-1016356970 None] Lock "cinder-a18aff80-d204-4870-949a-7502d7bbfccf-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:31 devstack sudo[96719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:31 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:31 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "cinder-8ad4a177-d11c-46d4-a2c9-6913586d06e7-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-8ad4a177-d11c-46d4-a2c9-6913586d06e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "cinder-quobyte-8ad4a177-d11c-46d4-a2c9-6913586d06e7" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-quobyte-8ad4a177-d11c-46d4-a2c9-6913586d06e7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Deleting offline snapshot 8ad4a177-d11c-46d4-a2c9-6913586d06e7 of volume 26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] snapshot_file for this snap is: volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[222e25d6-bd18-45df-87b2-a674a7798464]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:32 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:32 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:32 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.427s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26604de1-0636-40bb-9a7d-eab6052d4f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd9c842-da2b-4756-8c54-f89428dc742a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:32 devstack sudo[96729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f
Sep 11 06:21:32 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:32 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f" returned: 0 in 0.420s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:32 devstack sudo[96735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:32 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:33 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.383s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:33 devstack sudo[96741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7
Sep 11 06:21:33 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:33 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f.8ad4a177-d11c-46d4-a2c9-6913586d06e7" returned: 0 in 0.313s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-quobyte-8ad4a177-d11c-46d4-a2c9-6913586d06e7" released by "_delete_snapshot" :: held 1.695s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" released by "delete_snapshot" :: held 1.736s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Created reservations ['ac8af47f-ee53-467a-8618-588898e7e325', 'aeb343a7-b7c5-42d4-904e-770426fa92b1', 'a3064b26-23b1-4e44-893b-e92211b86926', '5519e0a2-f81f-4c6f-b4bb-0c4d0a722497'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:33 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Delete snapshot completed successfully.
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7a7ec9c6-92a2-4324-8e32-1337e0514086 tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-8ad4a177-d11c-46d4-a2c9-6913586d06e7-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Flow 'volume_create_manager' (f0dc774d-675e-4859-b7f6-6cd4390cc472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217c8bc3-5d4f-40a2-8183-648287394239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217c8bc3-5d4f-40a2-8183-648287394239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1385050725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadec0ce-5e3a-4765-a045-6efee357fd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aef05abc11a4b8a95dc9c03b171b8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:34Z,use_quota=True,user_id='9f8943e88d7e4986abee65e4aeeca309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f0baf6-15ad-4d1b-aca2-6d28980da838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f0baf6-15ad-4d1b-aca2-6d28980da838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6759831-68c9-4e6c-9a9f-10c892ad23fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6759831-68c9-4e6c-9a9f-10c892ad23fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadec0ce-5e3a-4765-a045-6efee357fd3c', 'volume_name': 'volume-aadec0ce-5e3a-4765-a045-6efee357fd3c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cc8a0e-d4bf-4fd2-9dc0-09acc324f2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cc8a0e-d4bf-4fd2-9dc0-09acc324f2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b1f903-4491-427f-b6f9-5339d259fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:33 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Volume aadec0ce-5e3a-4765-a045-6efee357fd3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadec0ce-5e3a-4765-a045-6efee357fd3c', 'volume_size': 1}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1385050725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadec0ce-5e3a-4765-a045-6efee357fd3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aef05abc11a4b8a95dc9c03b171b8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:34Z,use_quota=True,user_id='9f8943e88d7e4986abee65e4aeeca309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Creating volume aadec0ce-5e3a-4765-a045-6efee357fd3c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:34 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:34 devstack sudo[96744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c 1073741824
Sep 11 06:21:34 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "cinder-26604de1-0636-40bb-9a7d-eab6052d4f5f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-26604de1-0636-40bb-9a7d-eab6052d4f5f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dc475b-086c-46ae-bc86-919aefdcef95]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:34 devstack sudo[96749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f
Sep 11 06:21:34 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:34 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c 1073741824" returned: 0 in 0.565s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:34 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c
Sep 11 06:21:34 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:34 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:34 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f
Sep 11 06:21:34 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:34 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c" returned: 0 in 0.339s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b1f903-4491-427f-b6f9-5339d259fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadec0ce-5e3a-4765-a045-6efee357fd3c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775017bf-05db-4782-ae78-85a2f9839939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:34 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Volume volume-aadec0ce-5e3a-4765-a045-6efee357fd3c (aadec0ce-5e3a-4765-a045-6efee357fd3c): created successfully
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775017bf-05db-4782-ae78-85a2f9839939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Flow 'volume_create_manager' (f0dc774d-675e-4859-b7f6-6cd4390cc472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a02c9379-ab72-4a7f-a293-2314642bcb6a tempest-VolumeQuotasNegativeTestJSON-478387850 None] Created volume successfully.
Sep 11 06:21:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f7a6d3ec-48b9-49fc-abd9-4f55b9afbf2e tempest-GroupsTest-812389437 None] Group tempest-Group1-1818857924: creating
Sep 11 06:21:35 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-26604de1-0636-40bb-9a7d-eab6052d4f5f" returned: 0 in 0.370s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f7a6d3ec-48b9-49fc-abd9-4f55b9afbf2e tempest-GroupsTest-812389437 None] Group tempest-Group1-1818857924: created successfully
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-quobyte-26604de1-0636-40bb-9a7d-eab6052d4f5f" released by "delete_volume" :: held 0.869s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f7a6d3ec-48b9-49fc-abd9-4f55b9afbf2e tempest-GroupsTest-812389437 None] Create group completed successfully.
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Created reservations ['18d501c0-dd85-44bd-ac18-f181c32dec9f', '9e276f1c-8993-45dc-8087-d26bad7e42ca', '0974ce91-a240-4794-9b34-662427f92b6a', '919abf03-6ddd-4423-a575-d1da2d3d8d44'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:35 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:35 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:35 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Deleted volume successfully.
Sep 11 06:21:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9d67d410-5ead-4829-a9a2-aca041c4126f tempest-SnapshotsActionsTest-2078996601 None] Lock "cinder-26604de1-0636-40bb-9a7d-eab6052d4f5f-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-42a0de3d-0dff-4f56-a038-1f8e7dee05f1 tempest-GroupsTest-812389437 None] Group tempest-Group2-217615770: creating
Sep 11 06:21:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-42a0de3d-0dff-4f56-a038-1f8e7dee05f1 tempest-GroupsTest-812389437 None] Group tempest-Group2-217615770: created successfully
Sep 11 06:21:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-42a0de3d-0dff-4f56-a038-1f8e7dee05f1 tempest-GroupsTest-812389437 None] Create group completed successfully.
Sep 11 06:21:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Acquiring lock "cinder-aadec0ce-5e3a-4765-a045-6efee357fd3c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "cinder-aadec0ce-5e3a-4765-a045-6efee357fd3c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Acquiring lock "cinder-quobyte-aadec0ce-5e3a-4765-a045-6efee357fd3c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "cinder-quobyte-aadec0ce-5e3a-4765-a045-6efee357fd3c" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ee6b66-51a7-4848-a868-14fe7f4113c7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:37 devstack sudo[96765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c
Sep 11 06:21:37 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:38 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c" returned: 0 in 0.497s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:38 devstack sudo[96771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c
Sep 11 06:21:38 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:38 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Flow 'volume_create_manager' (832bf026-33f8-4b2b-b9b3-2f5f1d554272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4529d6c-b77e-4dea-abfc-f2b48f313eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aadec0ce-5e3a-4765-a045-6efee357fd3c" returned: 0 in 0.486s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4529d6c-b77e-4dea-abfc-f2b48f313eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-993682694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8954a0f2-56a3-499e-945f-cd684f94cab5,host='devstack@QuobyteHD#QuobyteHD',id=883f1ac3-0bac-422f-9076-c33c02926a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d995a196e4b5d97286952c2cc6b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:38Z,use_quota=True,user_id='ec34af4344d146c9a3f465734235c80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0973f61a-a1b4-4461-89e5-10b0b6720e38),volume_type_id=0973f61a-a1b4-4461-89e5-10b0b6720e38)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d062da-18e8-4d36-a53e-1b8c43d66b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d062da-18e8-4d36-a53e-1b8c43d66b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ff9183-c0d4-4365-ab96-96db681ab985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ff9183-c0d4-4365-ab96-96db681ab985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883f1ac3-0bac-422f-9076-c33c02926a35', 'volume_name': 'volume-883f1ac3-0bac-422f-9076-c33c02926a35', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a607e51d-94a8-42ca-9e01-7d739fda9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a607e51d-94a8-42ca-9e01-7d739fda9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07509e9-e668-4898-a0ca-da1d1dca562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:38 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Volume 883f1ac3-0bac-422f-9076-c33c02926a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883f1ac3-0bac-422f-9076-c33c02926a35', 'volume_size': 1}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8954a0f2-56a3-499e-945f-cd684f94cab5,created_at=2026-09-11T04:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-993682694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8954a0f2-56a3-499e-945f-cd684f94cab5,host='devstack@QuobyteHD#QuobyteHD',id=883f1ac3-0bac-422f-9076-c33c02926a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d995a196e4b5d97286952c2cc6b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:38Z,use_quota=True,user_id='ec34af4344d146c9a3f465734235c80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0973f61a-a1b4-4461-89e5-10b0b6720e38),volume_type_id=0973f61a-a1b4-4461-89e5-10b0b6720e38)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Creating volume 883f1ac3-0bac-422f-9076-c33c02926a35 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:38 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "cinder-quobyte-aadec0ce-5e3a-4765-a045-6efee357fd3c" released by "delete_volume" :: held 1.121s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:38 devstack sudo[96774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35 1073741824
Sep 11 06:21:38 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Created reservations ['84e0be2a-6494-4097-8459-476fb4c4dc2e', 'a9f078df-36f0-4af2-bb74-11c0c4c972c1', '57dab312-0568-4482-8889-1fade024b356', 'dd88fe1d-24ae-4aa8-9f28-5f8e8afd2f9b'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:38 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:38 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:39 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.336s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Deleted volume successfully.
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-49ef7608-3fef-4ac5-88c3-9f4b00dbbf17 tempest-VolumeQuotasNegativeTestJSON-478387850 None] Lock "cinder-aadec0ce-5e3a-4765-a045-6efee357fd3c-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:39 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35 1073741824" returned: 0 in 0.542s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:39 devstack sudo[96782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35
Sep 11 06:21:39 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:39 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35" returned: 0 in 0.266s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07509e9-e668-4898-a0ca-da1d1dca562e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883f1ac3-0bac-422f-9076-c33c02926a35', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef678e1-467f-4ba4-bc7e-ddc246d43329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:39 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Volume volume-883f1ac3-0bac-422f-9076-c33c02926a35 (883f1ac3-0bac-422f-9076-c33c02926a35): created successfully
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef678e1-467f-4ba4-bc7e-ddc246d43329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Flow 'volume_create_manager' (832bf026-33f8-4b2b-b9b3-2f5f1d554272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1690557d-8615-47dd-b6a2-7810dcf1c6a6 tempest-GroupsTest-812389437 None] Created volume successfully.
Sep 11 06:21:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Acquiring lock "cinder-quobyte-883f1ac3-0bac-422f-9076-c33c02926a35" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Lock "cinder-quobyte-883f1ac3-0bac-422f-9076-c33c02926a35" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b3693c-4217-4880-bbb5-1bb66909d96a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:40 devstack sudo[96785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35
Sep 11 06:21:40 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:40 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35" returned: 0 in 0.439s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:40 devstack sudo[96790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35
Sep 11 06:21:40 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:41 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-883f1ac3-0bac-422f-9076-c33c02926a35" returned: 0 in 0.309s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Lock "cinder-quobyte-883f1ac3-0bac-422f-9076-c33c02926a35" released by "delete_volume" :: held 0.810s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Created reservations ['846c9ceb-3cc6-4e59-98d6-d8d4e2267a2f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:41 devstack cinder-volume[88109]: WARNING cinder.quota [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-628036086 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-628036086, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:41 devstack cinder-volume[88109]: WARNING cinder.quota [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-628036086 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-628036086, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Created reservations ['16b86ac6-9ad9-431b-96fa-de7cc338699b', 'fd950b52-71be-4302-90a7-863f2c673337', 'a4770bb2-7bfc-458c-a00b-59e0b2eb8243', '073ef856-55cf-4496-bcf8-46c697b03ebe'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:41 devstack sudo[96793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:41 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:41 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.407s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:41 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4b700228-d7a9-47e3-9584-4c522741797e tempest-GroupsTest-812389437 None] Delete group completed successfully.
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Created reservations ['24e1d75b-e317-4d87-82c9-defa5206235a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:41 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:41 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:42 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:42 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6255c08f-9702-430c-9f21-8e84dd78fc9a tempest-GroupsTest-812389437 None] Delete group completed successfully.
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=145,cinder:UPDATE=143,cinder:INSERT=35,cinder:DELETE=7 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=178,cinder:SELECT=130,cinder:INSERT=43,cinder:DELETE=12 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Flow 'volume_create_manager' (a8bad6a7-3807-43bc-ad72-1e6566632482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4579a41a-af33-4dd4-ad50-389905106026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4579a41a-af33-4dd4-ad50-389905106026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1644033218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d87717-06f3-4610-a6e3-500923f85481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8434a7586cf84bd8979a853374634d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:43Z,use_quota=True,user_id='d5b6c094ea7944f1935176da0e171f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d07971f7-980f-4ea1-b1e8-27624092319a),volume_type_id=d07971f7-980f-4ea1-b1e8-27624092319a)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b139b4c-1322-49c5-80d6-a96017ad9526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b139b4c-1322-49c5-80d6-a96017ad9526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c472bebc-51d3-4b26-804d-68c2fc10c5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c472bebc-51d3-4b26-804d-68c2fc10c5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d87717-06f3-4610-a6e3-500923f85481', 'volume_name': 'volume-24d87717-06f3-4610-a6e3-500923f85481', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5838488d-adca-4b3b-b599-e7a86e21c1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5838488d-adca-4b3b-b599-e7a86e21c1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fadf11-b730-46c7-936a-5b951f097e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Volume 24d87717-06f3-4610-a6e3-500923f85481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d87717-06f3-4610-a6e3-500923f85481', 'volume_size': 1}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1644033218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d87717-06f3-4610-a6e3-500923f85481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8434a7586cf84bd8979a853374634d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:43Z,use_quota=True,user_id='d5b6c094ea7944f1935176da0e171f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d07971f7-980f-4ea1-b1e8-27624092319a),volume_type_id=d07971f7-980f-4ea1-b1e8-27624092319a)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Creating volume 24d87717-06f3-4610-a6e3-500923f85481 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:43 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:43 devstack sudo[96802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481 1073741824
Sep 11 06:21:43 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5bd7598d-050c-47d1-b013-c108c5366c6d tempest-GroupsTest-812389437 None] Group tempest-GroupsTest-Group-1896573286: creating
Sep 11 06:21:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5bd7598d-050c-47d1-b013-c108c5366c6d tempest-GroupsTest-812389437 None] Group tempest-GroupsTest-Group-1896573286: created successfully
Sep 11 06:21:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5bd7598d-050c-47d1-b013-c108c5366c6d tempest-GroupsTest-812389437 None] Create group completed successfully.
Sep 11 06:21:43 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481 1073741824" returned: 0 in 0.630s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:43 devstack sudo[96811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481
Sep 11 06:21:43 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:44 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481" returned: 0 in 0.263s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fadf11-b730-46c7-936a-5b951f097e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d87717-06f3-4610-a6e3-500923f85481', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8f3501-658c-4b90-8353-19d247c3f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:44 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Volume volume-24d87717-06f3-4610-a6e3-500923f85481 (24d87717-06f3-4610-a6e3-500923f85481): created successfully
Sep 11 06:21:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8f3501-658c-4b90-8353-19d247c3f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Flow 'volume_create_manager' (a8bad6a7-3807-43bc-ad72-1e6566632482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:44 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-67b16ebd-4b9d-4601-b848-6ee811d5f683 tempest-VolumeTypesAccessTest-1056701209 None] Created volume successfully.
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Flow 'volume_create_manager' (86190cb8-42a9-4db0-9186-a340688a6f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141a2f1-866f-4d58-93ca-17411ccb669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141a2f1-866f-4d58-93ca-17411ccb669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-625992080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89f521a1-9a63-46f2-be02-977c0b2e1fe2,host='devstack@QuobyteHD#QuobyteHD',id=c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d995a196e4b5d97286952c2cc6b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:45Z,use_quota=True,user_id='ec34af4344d146c9a3f465734235c80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c31bd548-9bb3-4d7e-a04f-e8a57b759b92),volume_type_id=c31bd548-9bb3-4d7e-a04f-e8a57b759b92)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e5de2d-ea17-4075-8867-bac764b3ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e5de2d-ea17-4075-8867-bac764b3ab85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8e0b75-3c63-4540-8de4-857e47ea174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8e0b75-3c63-4540-8de4-857e47ea174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f', 'volume_name': 'volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f52649d-7c01-4bec-bcaa-71d5fde56150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f52649d-7c01-4bec-bcaa-71d5fde56150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f03724-44ad-4f52-afb4-2da7c93e27f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Volume c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f', 'volume_size': 1}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=89f521a1-9a63-46f2-be02-977c0b2e1fe2,created_at=2026-09-11T04:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-625992080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89f521a1-9a63-46f2-be02-977c0b2e1fe2,host='devstack@QuobyteHD#QuobyteHD',id=c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d995a196e4b5d97286952c2cc6b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:45Z,use_quota=True,user_id='ec34af4344d146c9a3f465734235c80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c31bd548-9bb3-4d7e-a04f-e8a57b759b92),volume_type_id=c31bd548-9bb3-4d7e-a04f-e8a57b759b92)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Creating volume c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:45 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Acquiring lock "cinder-24d87717-06f3-4610-a6e3-500923f85481-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:45 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f 1073741824
Sep 11 06:21:45 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Lock "cinder-24d87717-06f3-4610-a6e3-500923f85481-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Acquiring lock "cinder-quobyte-24d87717-06f3-4610-a6e3-500923f85481" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Lock "cinder-quobyte-24d87717-06f3-4610-a6e3-500923f85481" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108ebf1-a967-4ae8-9e71-19fe7a127897]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:45 devstack sudo[96816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481
Sep 11 06:21:45 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:46 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f 1073741824" returned: 0 in 0.538s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:46 devstack sudo[96824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f
Sep 11 06:21:46 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:46 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481" returned: 0 in 0.574s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:46 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481
Sep 11 06:21:46 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:46 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f" returned: 0 in 0.377s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f03724-44ad-4f52-afb4-2da7c93e27f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf45aea3-917c-4f9b-bf14-3b85869d5113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:46 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Volume volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f (c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f): created successfully
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf45aea3-917c-4f9b-bf14-3b85869d5113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Flow 'volume_create_manager' (86190cb8-42a9-4db0-9186-a340688a6f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fa1a87fd-d702-45cf-8473-b1a898a4a70a tempest-GroupsTest-812389437 None] Created volume successfully.
Sep 11 06:21:46 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-24d87717-06f3-4610-a6e3-500923f85481" returned: 0 in 0.451s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Lock "cinder-quobyte-24d87717-06f3-4610-a6e3-500923f85481" released by "delete_volume" :: held 1.081s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:46 devstack cinder-volume[88109]: WARNING cinder.quota [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-737487445 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-737487445, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:46 devstack cinder-volume[88109]: WARNING cinder.quota [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-737487445 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-737487445, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Created reservations ['7279f611-fd6a-4a99-a4cc-e7c6f7acb91c', '0dbd4313-180e-48a6-b296-aa0cfe9a3e95', 'ab5e71bc-c698-4275-a041-a29726e46f74', '155ed70a-fc26-41f6-9126-c0820218cb98'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:46 devstack sudo[96833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:46 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:47 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.272s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Deleted volume successfully.
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2a8743e5-d005-4809-b7f5-1e83ef989493 tempest-VolumeTypesAccessTest-1056701209 None] Lock "cinder-24d87717-06f3-4610-a6e3-500923f85481-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Flow 'volume_create_manager' (12fa2bef-7143-480b-8766-19059c32efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644a0949-c34f-4c41-8d79-f725358e0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644a0949-c34f-4c41-8d79-f725358e0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-409017986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fdfc38618a48ba81383bc2b7cfec13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:48Z,use_quota=True,user_id='91e37d29e77446cfa4dbac0b3ea8afbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0fbf9a-a380-4a74-8077-690696e1686d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0fbf9a-a380-4a74-8077-690696e1686d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d8b6e7-6744-4a59-8f36-47e76e069237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d8b6e7-6744-4a59-8f36-47e76e069237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4', 'volume_name': 'volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be0406-7eca-4dbb-9870-da0f9ebfe2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be0406-7eca-4dbb-9870-da0f9ebfe2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2c162d-3cf8-48c0-a74b-914b075ea002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:47 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Volume 3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4', 'volume_size': 1}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-409017986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1fdfc38618a48ba81383bc2b7cfec13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:48Z,use_quota=True,user_id='91e37d29e77446cfa4dbac0b3ea8afbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Creating volume 3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:47 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:47 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 1073741824
Sep 11 06:21:47 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Flow 'volume_create_manager' (ba9f4f4a-ff84-4cba-9a17-45ca8960f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:48 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac5179c-37b8-4f49-b9e0-8a534baa3bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 1073741824" returned: 0 in 0.651s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac5179c-37b8-4f49-b9e0-8a534baa3bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-917704743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89f521a1-9a63-46f2-be02-977c0b2e1fe2,host='devstack@QuobyteHD#QuobyteHD',id=40f9ca1c-0628-47fb-9325-eab9ae819ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d995a196e4b5d97286952c2cc6b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:48Z,use_quota=True,user_id='ec34af4344d146c9a3f465734235c80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c31bd548-9bb3-4d7e-a04f-e8a57b759b92),volume_type_id=c31bd548-9bb3-4d7e-a04f-e8a57b759b92)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bf9079-b6ff-48ad-83ad-8b5f7b577ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bf9079-b6ff-48ad-83ad-8b5f7b577ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e74d27c-0cb2-4173-bd48-f5cabed398c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e74d27c-0cb2-4173-bd48-f5cabed398c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f9ca1c-0628-47fb-9325-eab9ae819ccb', 'volume_name': 'volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6aade53-83a7-4ebc-b3ad-4f562ec39e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6aade53-83a7-4ebc-b3ad-4f562ec39e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4027aa1a-aac4-4258-9178-4dba64a0d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:48 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Volume 40f9ca1c-0628-47fb-9325-eab9ae819ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb', 'volume_size': 1}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:48 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4
Sep 11 06:21:48 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:48 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4" returned: 0 in 0.300s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=89f521a1-9a63-46f2-be02-977c0b2e1fe2,created_at=2026-09-11T04:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-917704743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89f521a1-9a63-46f2-be02-977c0b2e1fe2,host='devstack@QuobyteHD#QuobyteHD',id=40f9ca1c-0628-47fb-9325-eab9ae819ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d995a196e4b5d97286952c2cc6b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:48Z,use_quota=True,user_id='ec34af4344d146c9a3f465734235c80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c31bd548-9bb3-4d7e-a04f-e8a57b759b92),volume_type_id=c31bd548-9bb3-4d7e-a04f-e8a57b759b92)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Creating volume 40f9ca1c-0628-47fb-9325-eab9ae819ccb {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:49 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2c162d-3cf8-48c0-a74b-914b075ea002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:49 devstack sudo[96846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb 1073741824
Sep 11 06:21:49 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c38e651-ccd3-45c1-984d-4f7f4f74f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Volume volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 (3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4): created successfully
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c38e651-ccd3-45c1-984d-4f7f4f74f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Flow 'volume_create_manager' (12fa2bef-7143-480b-8766-19059c32efb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:49 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-98a58c49-36aa-4b22-b290-14d8a921e763 tempest-VolumesServicesTestJSON-743302672 None] Created volume successfully.
Sep 11 06:21:49 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb 1073741824" returned: 0 in 0.573s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:49 devstack sudo[96852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb
Sep 11 06:21:49 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:49 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb" returned: 0 in 0.291s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4027aa1a-aac4-4258-9178-4dba64a0d519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cb18db-e496-4628-8adb-0e11d6923839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Volume volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb (40f9ca1c-0628-47fb-9325-eab9ae819ccb): created successfully
Sep 11 06:21:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cb18db-e496-4628-8adb-0e11d6923839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Flow 'volume_create_manager' (ba9f4f4a-ff84-4cba-9a17-45ca8960f48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:50 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9fee0785-a709-4e32-8b8c-0db16402ec7a tempest-GroupsTest-812389437 None] Created volume successfully.
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Acquiring lock "cinder-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Lock "cinder-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Acquiring lock "cinder-quobyte-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Lock "cinder-quobyte-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7efc7e-e5f2-4513-afe7-75450f6f3ea7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:50 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4
Sep 11 06:21:50 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:50 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4" returned: 0 in 0.393s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:50 devstack sudo[96860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4
Sep 11 06:21:50 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:50 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4" returned: 0 in 0.307s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Lock "cinder-quobyte-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4" released by "delete_volume" :: held 0.758s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Created reservations ['704f5671-c330-4cd9-b5ca-143403f7e943', '563468ac-91cf-4061-87b9-42154ecc7371', 'e173e1ff-caf2-48de-b95b-aab36f487638', '886b8142-12a8-4a6e-81bf-9a7f24a567ee'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-86a83d53-7809-4eb5-addc-e3aac13aeb56 tempest-GroupsTest-812389437 None] Update group completed successfully.
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:51 devstack sudo[96863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:51 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:51 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.341s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Deleted volume successfully.
Sep 11 06:21:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2d1ac60a-d560-4b53-9902-f248fce598b3 tempest-VolumesServicesTestJSON-743302672 None] Lock "cinder-3c2dc779-c06e-46e6-b1e0-12f9af9ec5c4-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c13a70b2-f3de-4ea6-a216-457569a41a11 tempest-GroupsTest-812389437 None] Update group completed successfully.
Sep 11 06:21:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Acquiring lock "cinder-quobyte-40f9ca1c-0628-47fb-9325-eab9ae819ccb" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Lock "cinder-quobyte-40f9ca1c-0628-47fb-9325-eab9ae819ccb" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:54 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ecb56c-02c7-4647-a962-2bfec48c5ec3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:54 devstack sudo[96866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb
Sep 11 06:21:54 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:54 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb" returned: 0 in 0.480s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:55 devstack sudo[96871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb
Sep 11 06:21:55 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:55 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40f9ca1c-0628-47fb-9325-eab9ae819ccb" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Lock "cinder-quobyte-40f9ca1c-0628-47fb-9325-eab9ae819ccb" released by "delete_volume" :: held 0.874s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Acquiring lock "cinder-quobyte-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Lock "cinder-quobyte-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8081dd-c4a6-4d09-9304-59cf94b17083]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:55 devstack sudo[96874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f
Sep 11 06:21:55 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:55 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f" returned: 0 in 0.453s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:55 devstack sudo[96879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f
Sep 11 06:21:55 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:56 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Lock "cinder-quobyte-c6c3e5cb-a5f0-4b72-9092-f13b0be1bb6f" released by "delete_volume" :: held 0.799s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Created reservations ['c37e27f3-8266-4f5e-a15b-d06469c62fa8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:56 devstack cinder-volume[88109]: WARNING cinder.quota [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2109327481 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2109327481, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:56 devstack cinder-volume[88109]: WARNING cinder.quota [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2109327481 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2109327481, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Created reservations ['74025e1c-f6f0-4ef0-996d-20c61b1fd69d', '7a2bd665-a095-4894-b7bd-c28cdcef925e', '83ae19e3-3704-4578-9f90-47d771b0e405', '14be9f58-a8fc-4516-9ffe-d3531757fc7f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Created reservations ['6cb878b6-2f00-4807-b577-32f4eba351dd', '8db4ed0e-a44f-4c59-9906-24ac068125a5', '405da6d5-ce59-45a7-b0e6-8abceca7c72c', 'ffa62b6b-b06b-4b47-b57d-6f0db2b01788'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:56 devstack sudo[96882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:56 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Flow 'volume_create_manager' (68555673-4bfd-4516-88e0-e2a3e65efb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ee59eb-6764-4e03-9a65-52838527b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ee59eb-6764-4e03-9a65-52838527b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1614403545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e00b90-f978-4563-8cbb-d0d7fd351118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a8ea046f6840fb99f782b0aa2d73f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:57Z,use_quota=True,user_id='9115986afa5a4427a01c83a8a207f603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c650015c-c1e3-40fc-95ab-35a8deb82bb3),volume_type_id=c650015c-c1e3-40fc-95ab-35a8deb82bb3)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99d394b-7c48-47a3-a578-e13ea00f6d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99d394b-7c48-47a3-a578-e13ea00f6d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61887b60-331c-409b-a424-4286c1a8895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61887b60-331c-409b-a424-4286c1a8895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e00b90-f978-4563-8cbb-d0d7fd351118', 'volume_name': 'volume-71e00b90-f978-4563-8cbb-d0d7fd351118', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:56 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a382d430-a7d3-4546-89f5-5d74568ef382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a382d430-a7d3-4546-89f5-5d74568ef382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d03228-52a3-4729-9299-afda9357ffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:56 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Volume 71e00b90-f978-4563-8cbb-d0d7fd351118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e00b90-f978-4563-8cbb-d0d7fd351118', 'volume_size': 1}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1614403545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e00b90-f978-4563-8cbb-d0d7fd351118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93a8ea046f6840fb99f782b0aa2d73f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:21:57Z,use_quota=True,user_id='9115986afa5a4427a01c83a8a207f603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c650015c-c1e3-40fc-95ab-35a8deb82bb3),volume_type_id=c650015c-c1e3-40fc-95ab-35a8deb82bb3)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Creating volume 71e00b90-f978-4563-8cbb-d0d7fd351118 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:21:56 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.350s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:56 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b038c0f0-961a-4332-a939-879a740f1396 tempest-GroupsTest-812389437 None] Delete group completed successfully.
Sep 11 06:21:56 devstack sudo[96885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118 1073741824
Sep 11 06:21:57 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:57 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118 1073741824" returned: 0 in 0.585s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:57 devstack sudo[96892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118
Sep 11 06:21:57 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:57 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118" returned: 0 in 0.342s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d03228-52a3-4729-9299-afda9357ffd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e00b90-f978-4563-8cbb-d0d7fd351118', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c363b6b-cd74-4f35-9ff6-a4a4f57cfd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:21:57 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Volume volume-71e00b90-f978-4563-8cbb-d0d7fd351118 (71e00b90-f978-4563-8cbb-d0d7fd351118): created successfully
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c363b6b-cd74-4f35-9ff6-a4a4f57cfd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:21:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Flow 'volume_create_manager' (68555673-4bfd-4516-88e0-e2a3e65efb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:21:58 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-84b88430-97f4-488d-bca6-b6822d4cff03 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Created volume successfully.
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:21:59 devstack sudo[96896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:21:59 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:21:59 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:21:59 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:21:59 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-86970aeb-9302-4646-b43d-b9ec4f2d216b tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Retype volume completed successfully.
Sep 11 06:22:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Acquiring lock "cinder-71e00b90-f978-4563-8cbb-d0d7fd351118-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "cinder-71e00b90-f978-4563-8cbb-d0d7fd351118-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Acquiring lock "cinder-quobyte-71e00b90-f978-4563-8cbb-d0d7fd351118" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "cinder-quobyte-71e00b90-f978-4563-8cbb-d0d7fd351118" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:00 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e788c-2adb-4ed4-8ff2-e624451d007f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:01 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118
Sep 11 06:22:01 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:01 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118" returned: 0 in 0.400s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:01 devstack sudo[96905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118
Sep 11 06:22:01 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:01 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-71e00b90-f978-4563-8cbb-d0d7fd351118" returned: 0 in 0.365s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "cinder-quobyte-71e00b90-f978-4563-8cbb-d0d7fd351118" released by "delete_volume" :: held 0.832s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:01 devstack cinder-volume[88109]: WARNING cinder.quota [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:22:01 devstack cinder-volume[88109]: WARNING cinder.quota [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Created reservations ['71b10c8f-9fd4-4177-ac62-be1d654458e8', 'af71cd06-9a0c-443e-b57c-05126b03200e', '4e4d0df6-0603-4783-9479-70921714f9ec', 'f82dc1b8-73a4-44f7-b6e0-fced79ab3e3a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:01 devstack sudo[96908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:01 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:02 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.417s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:22:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Deleted volume successfully.
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eb59b7ab-c73d-4235-870c-f959125b6cd4 tempest-VolumeRetypeWithoutMigrationTest-1531894921 None] Lock "cinder-71e00b90-f978-4563-8cbb-d0d7fd351118-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Flow 'volume_create_manager' (7787b818-54f2-4e59-924e-7136b1141d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950b5f88-d134-474c-addd-c57e5cfb3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950b5f88-d134-474c-addd-c57e5cfb3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-377806416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d4558b-1621-4905-a062-d6e780c75b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acad4054c1134163a03971a07a11670d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:03Z,use_quota=True,user_id='1616b2e5bf63419f9475fc08eec07a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f930d0f-7dfa-4356-9eda-11da8886b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f930d0f-7dfa-4356-9eda-11da8886b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1512c9e8-2062-4be1-8070-1124b075fe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:02 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1512c9e8-2062-4be1-8070-1124b075fe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93d4558b-1621-4905-a062-d6e780c75b77', 'volume_name': 'volume-93d4558b-1621-4905-a062-d6e780c75b77', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e03174e0650>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac6d34f-d1e2-4750-8458-81b6751459ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac6d34f-d1e2-4750-8458-81b6751459ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d87d0a-f296-47a6-a525-0edaf9375081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Volume 93d4558b-1621-4905-a062-d6e780c75b77: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93d4558b-1621-4905-a062-d6e780c75b77', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e03174e0650>}
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Trying to clone 93d4558b-1621-4905-a062-d6e780c75b77 from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:22:03 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7026dbb9-89d5-4f1d-a7ab-b1234024b682]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:03 devstack sudo[96913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD
Sep 11 06:22:03 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:04 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 is fetched for user 1616b2e5bf63419f9475fc08eec07a4f. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd41eb-0c44-4090-a8b8-3174d4cb2f86]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:04 devstack sudo[96918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD
Sep 11 06:22:04 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:04 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-377806416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d4558b-1621-4905-a062-d6e780c75b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acad4054c1134163a03971a07a11670d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:03Z,use_quota=True,user_id='1616b2e5bf63419f9475fc08eec07a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Creating volume 93d4558b-1621-4905-a062-d6e780c75b77 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:04 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:04 devstack sudo[96923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 1073741824
Sep 11 06:22:04 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:05 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 1073741824" returned: 0 in 0.633s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:05 devstack sudo[96929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77
Sep 11 06:22:05 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:05 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77" returned: 0 in 0.346s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Attempting download of 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume 93d4558b-1621-4905-a062-d6e780c75b77. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aa41c5-a636-4cf2-b37a-e31085a9f9ae]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_x1i_q35k {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:06 devstack sudo[96932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_x1i_q35k
Sep 11 06:22:06 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:06 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_x1i_q35k" returned: 0 in 0.432s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_x1i_q35k {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:06 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_x1i_q35k
Sep 11 06:22:06 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:06 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_x1i_q35k" returned: 1 in 0.456s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_x1i_q35k' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:22:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6cb15b-184e-46c3-afdd-1ea857443005]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:07 devstack sudo[96940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD
Sep 11 06:22:07 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:07 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:07 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] 02c3cc94-2cbe-438e-96aa-813e3f248ce8 was qcow2, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:22:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:07 devstack sudo[96945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77
Sep 11 06:22:07 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:09 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77" returned: 0 in 2.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:09 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_n5b9uufodevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:22:09 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Converted 112.00 MB image at 48.68 MB/s
Sep 11 06:22:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:09 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 1G
Sep 11 06:22:09 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:10 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 1G" returned: 0 in 0.472s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Downloaded image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume 93d4558b-1621-4905-a062-d6e780c75b77 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 for user 1616b2e5bf63419f9475fc08eec07a4f is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Marking volume 93d4558b-1621-4905-a062-d6e780c75b77 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Copying metadata from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 to 93d4558b-1621-4905-a062-d6e780c75b77. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Creating volume glance metadata for volume 93d4558b-1621-4905-a062-d6e780c75b77 backed by image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d87d0a-f296-47a6-a525-0edaf9375081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d4558b-1621-4905-a062-d6e780c75b77', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e03174e0650>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c12a2b-3a20-47c0-b4cc-b051fa26539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Volume volume-93d4558b-1621-4905-a062-d6e780c75b77 (93d4558b-1621-4905-a062-d6e780c75b77): created successfully
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c12a2b-3a20-47c0-b4cc-b051fa26539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Flow 'volume_create_manager' (7787b818-54f2-4e59-924e-7136b1141d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1e5d9cbd-d889-4f67-b25d-6c6271d07b46 tempest-VolumesExtendTest-896423342 None] Created volume successfully.
Sep 11 06:22:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d84da2e-d26f-4053-acbb-87b7530a0fce]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:11 devstack sudo[96959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77
Sep 11 06:22:11 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:12 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77" returned: 0 in 0.509s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 2G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 2G" returned: 0 in 0.141s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.691s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-48081cbf-07dc-4fc8-bf05-96702380304c tempest-VolumesExtendTest-896423342 None] Extend volume completed successfully.
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Acquiring lock "cinder-93d4558b-1621-4905-a062-d6e780c75b77-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Lock "cinder-93d4558b-1621-4905-a062-d6e780c75b77-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Acquiring lock "cinder-quobyte-93d4558b-1621-4905-a062-d6e780c75b77" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-93d4558b-1621-4905-a062-d6e780c75b77" acquired by "delete_volume" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c357aa-0aa2-45ca-87ce-537790669979]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:13 devstack sudo[96969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77
Sep 11 06:22:13 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:13 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77" returned: 0 in 0.446s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:13 devstack sudo[96974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77
Sep 11 06:22:13 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:14 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-93d4558b-1621-4905-a062-d6e780c75b77" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-93d4558b-1621-4905-a062-d6e780c75b77" released by "delete_volume" :: held 0.818s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Created reservations ['74fb4ec2-c10f-49c1-88a0-e7a1eec944a2', 'c59a84b6-d350-4ac4-8ac5-c8be734aeeed', '9ae7d82a-ca6b-4d64-acad-d4b1b1ce14c1', 'b11eb228-053c-49e9-a858-93e96e26602f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:14 devstack sudo[96977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:14 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:14 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.362s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:22:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Deleted volume successfully.
Sep 11 06:22:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-dfd4ebbb-751f-421d-8ab8-67276fd06556 tempest-VolumesExtendTest-896423342 None] Lock "cinder-93d4558b-1621-4905-a062-d6e780c75b77-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Flow 'volume_create_manager' (a6fb6cb4-f3cd-4b0a-b479-e92e74d07fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b1e83d-a6a2-4775-9ea8-898c30b1b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b1e83d-a6a2-4775-9ea8-898c30b1b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1121013097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab5490e-c1d3-40e1-b959-4d2f76b65fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acad4054c1134163a03971a07a11670d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:15Z,use_quota=True,user_id='1616b2e5bf63419f9475fc08eec07a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a1b1c1-c745-40d2-83ab-c2286d706a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a1b1c1-c745-40d2-83ab-c2286d706a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647dc70-3347-452d-8ae2-323ae40f4231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647dc70-3347-452d-8ae2-323ae40f4231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab5490e-c1d3-40e1-b959-4d2f76b65fe6', 'volume_name': 'volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b351391f-24fb-4b3d-938b-81248d703fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b351391f-24fb-4b3d-938b-81248d703fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da629a4-a7d2-42d7-9003-2f33967a1d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:15 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Volume dab5490e-c1d3-40e1-b959-4d2f76b65fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6', 'volume_size': 1}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1121013097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab5490e-c1d3-40e1-b959-4d2f76b65fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acad4054c1134163a03971a07a11670d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:15Z,use_quota=True,user_id='1616b2e5bf63419f9475fc08eec07a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Creating volume dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:15 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:15 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 1073741824
Sep 11 06:22:15 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:15 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 1073741824" returned: 0 in 0.675s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:16 devstack sudo[96987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6
Sep 11 06:22:16 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Flow 'volume_create_manager' (12d8e3b1-28f8-46c9-9186-8ddd17a31c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0812759-636a-472e-91d7-72f51c24df72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0812759-636a-472e-91d7-72f51c24df72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-842842525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e18715e-98cb-419a-861a-fc3a09e96e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f88753f53d468eadbdc2022e0794ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:16Z,use_quota=True,user_id='331bcc8b39ff4f55b35b5833bdd72eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81210191-f860-4ae3-ba0b-63cbb68a4b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:16 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81210191-f860-4ae3-ba0b-63cbb68a4b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800d51e6-fed1-413a-a7ab-ac45d9309085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800d51e6-fed1-413a-a7ab-ac45d9309085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e18715e-98cb-419a-861a-fc3a09e96e0a', 'volume_name': 'volume-8e18715e-98cb-419a-861a-fc3a09e96e0a', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a1fc3f-d87d-47ca-a94c-528c49a7b10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a1fc3f-d87d-47ca-a94c-528c49a7b10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a3fd98-d632-4f24-84ba-bd59478c0972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:16 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Volume 8e18715e-98cb-419a-861a-fc3a09e96e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e18715e-98cb-419a-861a-fc3a09e96e0a', 'volume_size': 1}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" returned: 0 in 0.484s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-842842525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e18715e-98cb-419a-861a-fc3a09e96e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f88753f53d468eadbdc2022e0794ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:16Z,use_quota=True,user_id='331bcc8b39ff4f55b35b5833bdd72eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Creating volume 8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:16 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da629a4-a7d2-42d7-9003-2f33967a1d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:16 devstack sudo[96990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a 1073741824
Sep 11 06:22:16 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1950b92-745c-4998-8ca8-a08aa3062e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:16 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Volume volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 (dab5490e-c1d3-40e1-b959-4d2f76b65fe6): created successfully
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1950b92-745c-4998-8ca8-a08aa3062e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Flow 'volume_create_manager' (a6fb6cb4-f3cd-4b0a-b479-e92e74d07fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fac0dc1f-b240-4af3-8189-ac1940b36f73 tempest-VolumesExtendTest-896423342 None] Created volume successfully.
Sep 11 06:22:17 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a 1073741824" returned: 0 in 0.637s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:17 devstack sudo[96996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a
Sep 11 06:22:17 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:17 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a" returned: 0 in 0.394s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a3fd98-d632-4f24-84ba-bd59478c0972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e18715e-98cb-419a-861a-fc3a09e96e0a', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e98c746-5439-4429-96ee-047c24c03ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Creating offline snapshot f262d52f-5a8a-4162-8117-aea13ae383da of volume dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:22:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Volume volume-8e18715e-98cb-419a-861a-fc3a09e96e0a (8e18715e-98cb-419a-861a-fc3a09e96e0a): created successfully
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e98c746-5439-4429-96ee-047c24c03ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Flow 'volume_create_manager' (12d8e3b1-28f8-46c9-9186-8ddd17a31c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d8279b-808c-4f51-a2ae-60209d1c0a2d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4fe53c05-26ce-4c9f-bdc2-5101045dbc84 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Created volume successfully.
Sep 11 06:22:17 devstack sudo[97000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6
Sep 11 06:22:17 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:18 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" returned: 0 in 0.400s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:18 devstack sudo[97005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da 1G
Sep 11 06:22:18 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:18 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da 1G" returned: 0 in 0.544s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:18 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da
Sep 11 06:22:18 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:19 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da" returned: 0 in 0.374s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:19 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da is being set with open permissions: ugo+rw
Sep 11 06:22:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:19 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da
Sep 11 06:22:19 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:19 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da" returned: 0 in 0.324s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:19 devstack sudo[97020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.info
Sep 11 06:22:19 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:19 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.info" returned: 0 in 0.261s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:19 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.info is being set with open permissions: ugo+rw
Sep 11 06:22:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:19 devstack sudo[97023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.info
Sep 11 06:22:19 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:20 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.info" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.202s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Creating offline snapshot b4957405-0ef8-44d4-ac19-39f1b5e21b9e of volume 8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:22:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b01deb2f-297d-421b-b8a0-123a8cb8fe48 tempest-VolumesExtendTest-896423342 None] Create snapshot completed successfully
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eff19da-7f2a-4d43-b6ff-8aafb3f8a8ad]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:20 devstack sudo[97026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a
Sep 11 06:22:20 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:20 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a" returned: 0 in 0.426s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:20 devstack sudo[97031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e 1G
Sep 11 06:22:20 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:21 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e 1G" returned: 0 in 0.522s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e18715e-98cb-419a-861a-fc3a09e96e0a -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:21 devstack sudo[97037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e18715e-98cb-419a-861a-fc3a09e96e0a -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e
Sep 11 06:22:21 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:21 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e18715e-98cb-419a-861a-fc3a09e96e0a -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e" returned: 0 in 0.382s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:21 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e is being set with open permissions: ugo+rw
Sep 11 06:22:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:21 devstack sudo[97042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e
Sep 11 06:22:21 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:21 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e" returned: 0 in 0.273s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:21 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.info
Sep 11 06:22:21 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:22 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.info" returned: 0 in 0.293s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:22 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.info is being set with open permissions: ugo+rw
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:22 devstack sudo[97048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.info
Sep 11 06:22:22 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:22 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.info" returned: 0 in 0.277s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.263s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b0a19-0ad3-4476-98e9-087d32f6578f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:22 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-94d49b08-c708-44b1-8ab3-4664461df577 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Create snapshot completed successfully
Sep 11 06:22:22 devstack sudo[97051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6
Sep 11 06:22:22 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:22 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" returned: 0 in 0.418s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da 2G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da 2G" returned: 0 in 0.156s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.627s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-901d5ce3-d0a9-4079-b3fd-67f817d3f259 tempest-VolumesExtendTest-896423342 None] Extend volume completed successfully.
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Acquiring lock "cinder-f262d52f-5a8a-4162-8117-aea13ae383da-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Lock "cinder-f262d52f-5a8a-4162-8117-aea13ae383da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Acquiring lock "cinder-quobyte-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Acquiring lock "cinder-quobyte-f262d52f-5a8a-4162-8117-aea13ae383da" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-f262d52f-5a8a-4162-8117-aea13ae383da" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Deleting offline snapshot f262d52f-5a8a-4162-8117-aea13ae383da of volume dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] snapshot_file for this snap is: volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1bb92-7db1-4b4f-8977-be8d3181b87c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "cinder-b4957405-0ef8-44d4-ac19-39f1b5e21b9e-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-b4957405-0ef8-44d4-ac19-39f1b5e21b9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "cinder-quobyte-8e18715e-98cb-419a-861a-fc3a09e96e0a" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:23 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da
Sep 11 06:22:23 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-quobyte-8e18715e-98cb-419a-861a-fc3a09e96e0a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "cinder-quobyte-b4957405-0ef8-44d4-ac19-39f1b5e21b9e" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-quobyte-b4957405-0ef8-44d4-ac19-39f1b5e21b9e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Deleting offline snapshot b4957405-0ef8-44d4-ac19-39f1b5e21b9e of volume 8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] snapshot_file for this snap is: volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc932de-f628-4a68-9b08-1bd2e5e3aba2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:23 devstack sudo[97097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e
Sep 11 06:22:23 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:24 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da" returned: 0 in 0.567s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d65d2d-7f54-401d-8535-a90aa4286d3c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:24 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e" returned: 0 in 0.492s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e18715e-98cb-419a-861a-fc3a09e96e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:22:24 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6
Sep 11 06:22:24 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b75a4eb-4485-4cec-ad15-a2fa972d20a8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:24 devstack sudo[97109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a
Sep 11 06:22:24 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:24 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" returned: 0 in 0.471s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:24 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da
Sep 11 06:22:24 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:24 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a" returned: 0 in 0.550s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:24 devstack sudo[97119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e
Sep 11 06:22:24 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:25 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da" returned: 0 in 0.640s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:25 devstack sudo[97129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da
Sep 11 06:22:25 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:25 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e" returned: 0 in 0.469s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:25 devstack sudo[97131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e
Sep 11 06:22:25 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:25 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6.f262d52f-5a8a-4162-8117-aea13ae383da" returned: 0 in 0.293s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-f262d52f-5a8a-4162-8117-aea13ae383da" released by "_delete_snapshot" :: held 2.131s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" released by "delete_snapshot" :: held 2.158s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:25 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a.b4957405-0ef8-44d4-ac19-39f1b5e21b9e" returned: 0 in 0.330s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-quobyte-b4957405-0ef8-44d4-ac19-39f1b5e21b9e" released by "_delete_snapshot" :: held 2.003s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-quobyte-8e18715e-98cb-419a-861a-fc3a09e96e0a" released by "delete_snapshot" :: held 2.040s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Created reservations ['9b4ec4d8-dbf7-41c9-9174-daa452b1445d', 'd8647e1d-7783-4da0-863d-9a1755002f0b', '9a160dd8-bff7-4474-82a2-351164c62f2b', '2e5e652b-f1d6-4e99-826e-e5dc9dd34eb8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Created reservations ['94819d9b-0b23-4b98-8cc1-390be3e65ec1', 'e1e4f4d0-3d08-46fe-8855-92de117b4636', 'bdbdd491-305a-45b9-bfb1-438b1546a897', 'dfbd4cae-f1ed-407e-9fca-30a094a3f4ec'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Delete snapshot completed successfully.
Sep 11 06:22:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3e17ecbf-b490-4860-9503-02385a433b51 tempest-VolumesExtendTest-896423342 None] Lock "cinder-f262d52f-5a8a-4162-8117-aea13ae383da-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Delete snapshot completed successfully.
Sep 11 06:22:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7d31d921-33c4-4220-b90d-91dc23278e82 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-b4957405-0ef8-44d4-ac19-39f1b5e21b9e-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Acquiring lock "cinder-dab5490e-c1d3-40e1-b959-4d2f76b65fe6-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Lock "cinder-dab5490e-c1d3-40e1-b959-4d2f76b65fe6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Acquiring lock "cinder-quobyte-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:26 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fcd23c-ea27-4cf8-b636-59f1eb2ab073]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "cinder-8e18715e-98cb-419a-861a-fc3a09e96e0a-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-8e18715e-98cb-419a-861a-fc3a09e96e0a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "cinder-quobyte-8e18715e-98cb-419a-861a-fc3a09e96e0a" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:27 devstack sudo[97135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6
Sep 11 06:22:27 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-quobyte-8e18715e-98cb-419a-861a-fc3a09e96e0a" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7c7c5a-262d-494b-b3a5-5d05bed7d9a9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:27 devstack sudo[97137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a
Sep 11 06:22:27 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:27 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" returned: 0 in 0.531s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:27 devstack sudo[97143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6
Sep 11 06:22:27 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:27 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a" returned: 0 in 0.504s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:27 devstack sudo[97149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a
Sep 11 06:22:27 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:27 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Lock "cinder-quobyte-dab5490e-c1d3-40e1-b959-4d2f76b65fe6" released by "delete_volume" :: held 0.965s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:27 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Created reservations ['667df9ed-435b-4146-ae65-c1595cf822bb', 'dca2abde-127d-4854-a911-4f11d418c13e', 'c171f59b-0087-4c38-ab9e-d1febec22c27', 'c3087598-4e51-4645-a0c9-9c06bb0a375f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:28 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8e18715e-98cb-419a-861a-fc3a09e96e0a" returned: 0 in 0.443s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:28 devstack sudo[97153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:28 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-quobyte-8e18715e-98cb-419a-861a-fc3a09e96e0a" released by "delete_volume" :: held 1.028s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Created reservations ['3b1af1c6-b8d1-4dc8-967c-7de4e250cf8f', '744b89da-df67-4513-bf4f-50b170fde53a', 'd3287094-43a4-4ba6-9eb5-e2512901d1d5', '5493ebde-6729-41df-b856-254f4254e690'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:28 devstack sudo[97156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:28 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:28 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.329s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:22:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Deleted volume successfully.
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ef134f91-b07f-418f-a7ed-83cea10cad5d tempest-VolumesExtendTest-896423342 None] Lock "cinder-dab5490e-c1d3-40e1-b959-4d2f76b65fe6-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:28 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.320s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:22:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Deleted volume successfully.
Sep 11 06:22:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c86dbab-5c7f-4ba0-9a93-69a2d0a6e852 tempest-VolumeSnapshotQuotasNegativeTestJSON-2119201331 None] Lock "cinder-8e18715e-98cb-419a-861a-fc3a09e96e0a-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:31 devstack sudo[97160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:31 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:31 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:22:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:22:38 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=104,cinder:UPDATE=115,cinder:DELETE=7,cinder:INSERT=35 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:22:38 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=95,cinder:UPDATE=121,cinder:INSERT=29,cinder:DELETE=9 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:22:38 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Flow 'volume_create_manager' (af9613bb-5957-481e-9b8f-8143bc4cd7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9b4d2-6ccf-4f72-8ec6-e5bf487e7fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9b4d2-6ccf-4f72-8ec6-e5bf487e7fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-673866462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f409e0e8-f8c5-4616-a4c9-b74ff2fecf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c396dbfa7544246a26010e451265695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:39Z,use_quota=True,user_id='b3944751759444cfb76cef4b6852be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9703fd-1095-4e2d-b3ea-4727a82f6365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9703fd-1095-4e2d-b3ea-4727a82f6365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460bed6f-d640-4840-bb44-bc6a4130ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460bed6f-d640-4840-bb44-bc6a4130ee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f409e0e8-f8c5-4616-a4c9-b74ff2fecf10', 'volume_name': 'volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030cbaee70>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc9413e-de8d-442f-8ead-014403e725e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc9413e-de8d-442f-8ead-014403e725e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8585ce-23ca-4e9f-a40a-6c8865286047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:39 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Volume f409e0e8-f8c5-4616-a4c9-b74ff2fecf10: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030cbaee70>}
Sep 11 06:22:39 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Trying to clone f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:22:40 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:22:40 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 06:22:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b636e-38d4-429f-94b9-e2c193566e07]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:40 devstack sudo[97189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD
Sep 11 06:22:40 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:40 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:40 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 is fetched for user b3944751759444cfb76cef4b6852be31. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:22:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7799124a-6dea-479d-8714-b1d43a427ddd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:40 devstack sudo[97194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD
Sep 11 06:22:40 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:41 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-673866462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f409e0e8-f8c5-4616-a4c9-b74ff2fecf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c396dbfa7544246a26010e451265695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:39Z,use_quota=True,user_id='b3944751759444cfb76cef4b6852be31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Creating volume f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:41 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:41 devstack sudo[97199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 1073741824
Sep 11 06:22:41 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:41 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 1073741824" returned: 0 in 0.899s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:42 devstack sudo[97256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10
Sep 11 06:22:42 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:42 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10" returned: 0 in 0.484s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:22:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:42 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Attempting download of 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume f409e0e8-f8c5-4616-a4c9-b74ff2fecf10. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:22:42 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[23648c02-9215-4b54-97dc-f199db4e6f76]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_dkqcn25o {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:42 devstack sudo[97270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_dkqcn25o
Sep 11 06:22:42 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:43 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_dkqcn25o" returned: 0 in 0.713s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_dkqcn25o {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:43 devstack sudo[97282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_dkqcn25o
Sep 11 06:22:43 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:44 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_dkqcn25o" returned: 1 in 0.532s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_dkqcn25o' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:22:44 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c554e9-f3de-4ce6-a70d-3e513256ee0d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:44 devstack sudo[97289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD
Sep 11 06:22:44 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:44 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:44 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] 02c3cc94-2cbe-438e-96aa-813e3f248ce8 was qcow2, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:22:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:44 devstack sudo[97294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10
Sep 11 06:22:44 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:47 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10" returned: 0 in 2.891s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:47 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_vzealbcpdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:22:47 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Converted 112.00 MB image at 38.72 MB/s
Sep 11 06:22:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:47 devstack sudo[97314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 1G
Sep 11 06:22:47 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:48 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 1G" returned: 0 in 0.612s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Downloaded image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 for user b3944751759444cfb76cef4b6852be31 is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Marking volume f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Copying metadata from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 to f409e0e8-f8c5-4616-a4c9-b74ff2fecf10. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Creating volume glance metadata for volume f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 backed by image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8585ce-23ca-4e9f-a40a-6c8865286047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030cbaee70>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11ffc4c-a0ee-4f29-b144-abff6bede36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:48 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Volume volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 (f409e0e8-f8c5-4616-a4c9-b74ff2fecf10): created successfully
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11ffc4c-a0ee-4f29-b144-abff6bede36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Flow 'volume_create_manager' (af9613bb-5957-481e-9b8f-8143bc4cd7ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3c6f2d6b-ea85-4ce3-b23d-212a6fc32a18 tempest-VolumesImageMetadata-559978046 None] Created volume successfully.
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (4cab3f81-cb62-46fc-9ce1-0f5e5f6655cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d914f2b-f86e-4b5b-8c7b-e3ad65add54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d914f2b-f86e-4b5b-8c7b-e3ad65add54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2028710008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f23f0f8-77c9-45c4-93a5-bc72d75c638d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:49Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f005dd-4e05-4f07-b93c-57db2388caca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f005dd-4e05-4f07-b93c-57db2388caca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e2648e-c998-45f5-83b9-c4159b3a5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e2648e-c998-45f5-83b9-c4159b3a5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f23f0f8-77c9-45c4-93a5-bc72d75c638d', 'volume_name': 'volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a28ca5-8f35-4a9e-ae11-778dca07490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a28ca5-8f35-4a9e-ae11-778dca07490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536194a0-1745-4154-a820-c4e8cc9c401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Volume 5f23f0f8-77c9-45c4-93a5-bc72d75c638d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d', 'volume_size': 1}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2028710008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f23f0f8-77c9-45c4-93a5-bc72d75c638d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:49Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Creating volume 5f23f0f8-77c9-45c4-93a5-bc72d75c638d {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:49 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:49 devstack sudo[97321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d 1073741824
Sep 11 06:22:49 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Acquiring lock "cinder-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:50 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d 1073741824" returned: 0 in 0.890s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Lock "cinder-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:50 devstack sudo[97326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d
Sep 11 06:22:50 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Acquiring lock "cinder-quobyte-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Lock "cinder-quobyte-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3057643-6024-4513-8920-4b2cf0e0466c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:51 devstack sudo[97328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10
Sep 11 06:22:51 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:51 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" returned: 0 in 0.729s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536194a0-1745-4154-a820-c4e8cc9c401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff4b856-8d10-41d7-b202-65d04218e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:51 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Volume volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d (5f23f0f8-77c9-45c4-93a5-bc72d75c638d): created successfully
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff4b856-8d10-41d7-b202-65d04218e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (4cab3f81-cb62-46fc-9ce1-0f5e5f6655cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-aa85f7c4-c6d7-4be1-bcfe-bc2a12b3d4e9 tempest-VolumesActionsTest-1604628463 None] Created volume successfully.
Sep 11 06:22:51 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10" returned: 0 in 0.850s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:51 devstack sudo[97334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10
Sep 11 06:22:51 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:52 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10" returned: 0 in 0.421s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Lock "cinder-quobyte-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10" released by "delete_volume" :: held 1.349s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Created reservations ['509f137f-cba9-4058-a3af-11fb7689a924', '89078839-f55c-4ff3-a95e-26d685444c19', '19eeb950-f6df-41b8-9ca9-ae3b8f67fddd', 'e761ba68-ef4c-416e-b7f8-87fb736e97d2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (4127b706-8ab5-48d1-855b-ac63d2c6e84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60905460-d7c6-48a8-bdc2-f86504c74b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:52 devstack sudo[97337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:52 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60905460-d7c6-48a8-bdc2-f86504c74b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-949360479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27e0b5a-edfd-4f1d-922c-1075dfffd4e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:52Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c644b5-a5ec-4d37-919b-a6fcf79e33ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c644b5-a5ec-4d37-919b-a6fcf79e33ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8e7e3f-51cc-4b0e-87aa-0f8d6fb93a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8e7e3f-51cc-4b0e-87aa-0f8d6fb93a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27e0b5a-edfd-4f1d-922c-1075dfffd4e5', 'volume_name': 'volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b74903-d7f9-401d-9ae9-00c96200b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b74903-d7f9-401d-9ae9-00c96200b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fedfe02-b6e4-478d-884a-6ba00b31a8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Volume e27e0b5a-edfd-4f1d-922c-1075dfffd4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5', 'volume_size': 1}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-949360479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27e0b5a-edfd-4f1d-922c-1075dfffd4e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:52Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Creating volume e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:52 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:52 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 1073741824
Sep 11 06:22:52 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:52 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.357s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:22:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Deleted volume successfully.
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cce225b6-5201-4ddf-a3b1-e7241b02e6c7 tempest-VolumesImageMetadata-559978046 None] Lock "cinder-f409e0e8-f8c5-4616-a4c9-b74ff2fecf10-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-619652b0-7856-4c13-836e-b8bff587f7e6 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" by "attach_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-619652b0-7856-4c13-836e-b8bff587f7e6 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" acquired by "attach_volume" :: waited 0.038s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-619652b0-7856-4c13-836e-b8bff587f7e6 tempest-VolumesActionsTest-1604628463 None] Attaching volume 5f23f0f8-77c9-45c4-93a5-bc72d75c638d to instance 762f6167-8eb1-4f13-96a9-d9925cc12d9e at mountpoint /dev/vdb on host None.
Sep 11 06:22:53 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-619652b0-7856-4c13-836e-b8bff587f7e6 tempest-VolumesActionsTest-1604628463 None] Attach volume completed successfully.
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 1073741824" returned: 0 in 0.668s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-619652b0-7856-4c13-836e-b8bff587f7e6 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" released by "attach_volume" :: held 0.199s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:53 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5
Sep 11 06:22:53 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:53 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5" returned: 0 in 0.546s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fedfe02-b6e4-478d-884a-6ba00b31a8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa81ca3-f1b0-4ac4-af85-e784d195765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Volume volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 (e27e0b5a-edfd-4f1d-922c-1075dfffd4e5): created successfully
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa81ca3-f1b0-4ac4-af85-e784d195765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (4127b706-8ab5-48d1-855b-ac63d2c6e84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1660772f-3d87-417c-b59a-4474678b552f tempest-VolumesGetTest-309627119 None] Created volume successfully.
Sep 11 06:22:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-547aed8b-f010-4b25-b2f3-440cd1e8a641 tempest-VolumesActionsTest-861284499 None] Terminate volume connection completed successfully.
Sep 11 06:22:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-547aed8b-f010-4b25-b2f3-440cd1e8a641 tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-detach_volume" by "detach_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-547aed8b-f010-4b25-b2f3-440cd1e8a641 tempest-VolumesActionsTest-861284499 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-547aed8b-f010-4b25-b2f3-440cd1e8a641 tempest-VolumesActionsTest-861284499 None] Detaching volume 5f23f0f8-77c9-45c4-93a5-bc72d75c638d from instance 762f6167-8eb1-4f13-96a9-d9925cc12d9e.
Sep 11 06:22:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-547aed8b-f010-4b25-b2f3-440cd1e8a641 tempest-VolumesActionsTest-861284499 None] Detach volume completed successfully.
Sep 11 06:22:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-547aed8b-f010-4b25-b2f3-440cd1e8a641 tempest-VolumesActionsTest-861284499 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb5fdd26-087b-41e4-81b7-c623fd9422ce tempest-VolumesActionsTest-1604628463 None] Acquiring lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-detach_volume" by "detach_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb5fdd26-087b-41e4-81b7-c623fd9422ce tempest-VolumesActionsTest-1604628463 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cb5fdd26-087b-41e4-81b7-c623fd9422ce tempest-VolumesActionsTest-1604628463 None] Volume detach called, but volume not attached.
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-cb5fdd26-087b-41e4-81b7-c623fd9422ce tempest-VolumesActionsTest-1604628463 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "cinder-quobyte-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-quobyte-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" acquired by "delete_volume" :: waited 0.070s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:55 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (118bc437-00b4-48e9-acd9-6003f31e7dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e345bf9f-4f01-4114-85a0-b4def6af6808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae5f13-a328-4f45-ba84-f7713e322294]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e345bf9f-4f01-4114-85a0-b4def6af6808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1863170635',display_name='tempest-VolumesGetTest-Volume-26959586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10b250a-89bb-46ec-ab8d-da0bff4be31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:56Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f890e7a1-b242-48de-85c5-4c8fe1e45feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f890e7a1-b242-48de-85c5-4c8fe1e45feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea038d9f-0e6a-4aaa-8bdb-8c4407a1021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea038d9f-0e6a-4aaa-8bdb-8c4407a1021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10b250a-89bb-46ec-ab8d-da0bff4be31f', 'volume_name': 'volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41e0059-46bb-4ab6-bdbb-a3e658f91e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41e0059-46bb-4ab6-bdbb-a3e658f91e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e5ebad-d808-4374-ae24-353b4c9b6896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:56 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Volume c10b250a-89bb-46ec-ab8d-da0bff4be31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f', 'volume_size': 1}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1863170635',display_name='tempest-VolumesGetTest-Volume-26959586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10b250a-89bb-46ec-ab8d-da0bff4be31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:56Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Creating volume c10b250a-89bb-46ec-ab8d-da0bff4be31f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:56 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:56 devstack sudo[97367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f 1073741824
Sep 11 06:22:56 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:56 devstack sudo[97366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d
Sep 11 06:22:56 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:56 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" returned: 0 in 0.544s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:56 devstack sudo[97377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d
Sep 11 06:22:56 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:56 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f 1073741824" returned: 0 in 0.626s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:56 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f
Sep 11 06:22:56 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:56 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-quobyte-5f23f0f8-77c9-45c4-93a5-bc72d75c638d" released by "delete_volume" :: held 1.012s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Created reservations ['71036c3e-c80e-4dce-a2c2-51ef82c80a22', '7ade3527-80f8-4c73-98dd-750028454607', '6e680df5-ca6e-4931-ac17-4aab4274b2af', '895f401f-56aa-4e01-82b8-0f68f810e5ef'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:57 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f" returned: 0 in 0.412s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:57 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:57 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e5ebad-d808-4374-ae24-353b4c9b6896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213af324-1991-4133-9427-a9ed4a896824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:57 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Volume volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f (c10b250a-89bb-46ec-ab8d-da0bff4be31f): created successfully
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213af324-1991-4133-9427-a9ed4a896824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (118bc437-00b4-48e9-acd9-6003f31e7dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c66e0a00-c7d8-443c-a176-1695705a118f tempest-VolumesGetTest-309627119 None] Created volume successfully.
Sep 11 06:22:57 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.310s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:22:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Deleted volume successfully.
Sep 11 06:22:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d4aa788a-8f10-4c35-a6e5-326e69756273 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-5f23f0f8-77c9-45c4-93a5-bc72d75c638d-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-c10b250a-89bb-46ec-ab8d-da0bff4be31f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Lock "cinder-c10b250a-89bb-46ec-ab8d-da0bff4be31f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-c10b250a-89bb-46ec-ab8d-da0bff4be31f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:22:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-c10b250a-89bb-46ec-ab8d-da0bff4be31f" acquired by "delete_volume" :: waited 0.035s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:22:58 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e5558b-aa4a-4b57-8db5-fee92731fcf7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:22:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:58 devstack sudo[97387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f
Sep 11 06:22:58 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Flow 'volume_create_manager' (2261ca8c-cc4e-4b34-9a94-039b930d975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ee2da5-894f-4b50-9a16-ee1d06dfeae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ee2da5-894f-4b50-9a16-ee1d06dfeae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-67700321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf77930b-1615-4a34-85e8-3e99087c0abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d159490153d4750a58aa61889608778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:59Z,use_quota=True,user_id='f9b1ac8f66f14ef98ce4deb210aa520b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff740c41-e75d-4efc-b8e1-8531394bd952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff740c41-e75d-4efc-b8e1-8531394bd952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d180dc42-3510-47da-8635-bcbae874c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d180dc42-3510-47da-8635-bcbae874c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf77930b-1615-4a34-85e8-3e99087c0abc', 'volume_name': 'volume-cf77930b-1615-4a34-85e8-3e99087c0abc', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:59 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f5c184-258c-4584-b19c-95d9e2ba9aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f5c184-258c-4584-b19c-95d9e2ba9aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e802c26e-42e4-46c5-9da8-e81ebc0dc641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:22:59 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Volume cf77930b-1615-4a34-85e8-3e99087c0abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf77930b-1615-4a34-85e8-3e99087c0abc', 'volume_size': 1}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-67700321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf77930b-1615-4a34-85e8-3e99087c0abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d159490153d4750a58aa61889608778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:22:59Z,use_quota=True,user_id='f9b1ac8f66f14ef98ce4deb210aa520b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Creating volume cf77930b-1615-4a34-85e8-3e99087c0abc {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:22:59 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f" returned: 0 in 0.810s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:59 devstack sudo[97412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc 1073741824
Sep 11 06:22:59 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:59 devstack sudo[97413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f
Sep 11 06:22:59 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:59 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c10b250a-89bb-46ec-ab8d-da0bff4be31f" returned: 0 in 0.357s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-c10b250a-89bb-46ec-ab8d-da0bff4be31f" released by "delete_volume" :: held 1.238s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Created reservations ['4c871905-30a1-4003-90aa-1eab52cbcb72', '52dca070-6814-4eaa-8544-2a6fd7e25a63', '60eb526a-ecf4-4b53-aacb-3bf727ca11a7', '706705ea-c733-4399-a5a3-c28e0253ffcb'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:22:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:22:59 devstack sudo[97422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:22:59 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:22:59 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc 1073741824" returned: 0 in 0.781s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:00 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc
Sep 11 06:23:00 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:00 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.515s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:00 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Deleted volume successfully.
Sep 11 06:23:00 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc" returned: 0 in 0.363s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8d7894cd-6dd2-4734-a9d2-0cf50d8c482d tempest-VolumesGetTest-309627119 None] Lock "cinder-c10b250a-89bb-46ec-ab8d-da0bff4be31f-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e802c26e-42e4-46c5-9da8-e81ebc0dc641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf77930b-1615-4a34-85e8-3e99087c0abc', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac088c1-a07c-4c16-9d67-53b8ce9f81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:00 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Volume volume-cf77930b-1615-4a34-85e8-3e99087c0abc (cf77930b-1615-4a34-85e8-3e99087c0abc): created successfully
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac088c1-a07c-4c16-9d67-53b8ce9f81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Flow 'volume_create_manager' (2261ca8c-cc4e-4b34-9a94-039b930d975f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:00 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9ea54f2b-ac0f-4c56-a33d-819faf71ce75 tempest-VolumesMetadataTest-545531854 None] Created volume successfully.
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Lock "cinder-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5" acquired by "delete_volume" :: waited 0.035s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df85c8f-43db-4be5-9878-68c3791886ac]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:01 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5
Sep 11 06:23:01 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:01 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5" returned: 0 in 0.612s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:01 devstack sudo[97436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5
Sep 11 06:23:01 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:01 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5" returned: 0 in 0.417s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5" released by "delete_volume" :: held 1.095s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Created reservations ['d030c6d8-cd29-49e6-bd82-7349ef6576dd', 'ec0e47ca-4317-4442-98a6-e71ef70017c3', 'c67bb332-ab2e-4f13-abb2-5cc0203c5eb2', '5c45c541-eae5-4157-9313-d1df530a47ad'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:02 devstack sudo[97439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:02 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Acquiring lock "cinder-cf77930b-1615-4a34-85e8-3e99087c0abc-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Lock "cinder-cf77930b-1615-4a34-85e8-3e99087c0abc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Acquiring lock "cinder-quobyte-cf77930b-1615-4a34-85e8-3e99087c0abc" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Lock "cinder-quobyte-cf77930b-1615-4a34-85e8-3e99087c0abc" acquired by "delete_volume" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:02 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.538s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Deleted volume successfully.
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac53de-3113-4af0-8695-d589e7c03450]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8c309248-1c12-4b84-8507-f5727a2ea0a5 tempest-VolumesGetTest-309627119 None] Lock "cinder-e27e0b5a-edfd-4f1d-922c-1075dfffd4e5-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:02 devstack sudo[97442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc
Sep 11 06:23:02 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (2c1b766c-2a3a-4efd-a13c-bf464bb76557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619efc69-094e-44c7-a416-ea0f64dd3017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619efc69-094e-44c7-a416-ea0f64dd3017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-386626456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05344a80-83a6-4fac-9d4c-9be7abae4bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:03Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fbf443-73bc-4671-a973-100ee71f7d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fbf443-73bc-4671-a973-100ee71f7d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce22776-fee7-476a-8e36-794f3e93cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce22776-fee7-476a-8e36-794f3e93cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05344a80-83a6-4fac-9d4c-9be7abae4bb6', 'volume_name': 'volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891e9d34-dc25-407a-bf00-f63586109bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891e9d34-dc25-407a-bf00-f63586109bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa1dce8-03a6-41ff-998e-cd88cca9789d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Volume 05344a80-83a6-4fac-9d4c-9be7abae4bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6', 'volume_size': 1}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-386626456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05344a80-83a6-4fac-9d4c-9be7abae4bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:03Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Creating volume 05344a80-83a6-4fac-9d4c-9be7abae4bb6 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:03 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:03 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc" returned: 0 in 0.628s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:03 devstack sudo[97448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6 1073741824
Sep 11 06:23:03 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:03 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc
Sep 11 06:23:03 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:03 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf77930b-1615-4a34-85e8-3e99087c0abc" returned: 0 in 0.395s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Lock "cinder-quobyte-cf77930b-1615-4a34-85e8-3e99087c0abc" released by "delete_volume" :: held 1.092s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Created reservations ['e38f284e-afec-469a-88eb-ba49ba7055f8', '91e51e71-60fe-49b3-9a99-34eca8013ec8', '2133e8d9-b72a-4c26-a097-66a9c30caae3', 'e9587827-ce59-4842-a481-8f395c62f2dd'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:04 devstack sudo[97457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:04 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (75d5726b-b9d5-4c6d-9146-5def9d1e5087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a470e01-e46b-4f7f-9a7d-9d27f52fe239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a470e01-e46b-4f7f-9a7d-9d27f52fe239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1733944343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b6102-e114-468e-aadc-ba642bcddeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:04Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a7fa87-43a5-4458-a7bd-500f0e0aadd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:04 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a7fa87-43a5-4458-a7bd-500f0e0aadd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8b6804-c579-4eca-8952-6bddac1e0a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8b6804-c579-4eca-8952-6bddac1e0a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19b6102-e114-468e-aadc-ba642bcddeca', 'volume_name': 'volume-c19b6102-e114-468e-aadc-ba642bcddeca', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1bd16d-32f2-435f-a6df-7dd6114ed925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1bd16d-32f2-435f-a6df-7dd6114ed925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d935ad-3323-499a-9d18-68f8e2824bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Volume c19b6102-e114-468e-aadc-ba642bcddeca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19b6102-e114-468e-aadc-ba642bcddeca', 'volume_size': 1}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6 1073741824" returned: 0 in 0.809s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:04 devstack sudo[97459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6
Sep 11 06:23:04 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:04 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Deleted volume successfully.
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac468bf1-4493-4ad5-8401-9e15da536431 tempest-VolumesMetadataTest-545531854 None] Lock "cinder-cf77930b-1615-4a34-85e8-3e99087c0abc-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:04 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1733944343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19b6102-e114-468e-aadc-ba642bcddeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:04Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Creating volume c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:04 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa1dce8-03a6-41ff-998e-cd88cca9789d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:04 devstack sudo[97463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca 1073741824
Sep 11 06:23:04 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e55ad6d-d0aa-4190-9d18-87c5f7012946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Volume volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6 (05344a80-83a6-4fac-9d4c-9be7abae4bb6): created successfully
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e55ad6d-d0aa-4190-9d18-87c5f7012946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (2c1b766c-2a3a-4efd-a13c-bf464bb76557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ea28cfcd-af3a-4e7e-8042-1648b83cb3e9 tempest-VolumesActionsTest-1604628463 None] Created volume successfully.
Sep 11 06:23:05 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca 1073741824" returned: 0 in 0.613s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:05 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca
Sep 11 06:23:05 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-05344a80-83a6-4fac-9d4c-9be7abae4bb6-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Lock "cinder-05344a80-83a6-4fac-9d4c-9be7abae4bb6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-quobyte-05344a80-83a6-4fac-9d4c-9be7abae4bb6" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-05344a80-83a6-4fac-9d4c-9be7abae4bb6" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09711450-1c22-4a35-bddb-9c9ad6d9e9cf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:05 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca" returned: 0 in 0.458s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d935ad-3323-499a-9d18-68f8e2824bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19b6102-e114-468e-aadc-ba642bcddeca', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70a6864-55b7-4089-943e-f279ec727183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:05 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Volume volume-c19b6102-e114-468e-aadc-ba642bcddeca (c19b6102-e114-468e-aadc-ba642bcddeca): created successfully
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70a6864-55b7-4089-943e-f279ec727183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (75d5726b-b9d5-4c6d-9146-5def9d1e5087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a5c99a72-96da-4f45-a6c3-2b48a6726a5b tempest-VolumesGetTest-309627119 None] Created volume successfully.
Sep 11 06:23:05 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6
Sep 11 06:23:05 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:06 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6" returned: 0 in 0.493s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:06 devstack sudo[97477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6
Sep 11 06:23:06 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:06 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05344a80-83a6-4fac-9d4c-9be7abae4bb6" returned: 0 in 0.369s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-05344a80-83a6-4fac-9d4c-9be7abae4bb6" released by "delete_volume" :: held 0.912s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Created reservations ['b28538c8-3be5-4ddd-9842-d98c6107f10b', '339954f7-e9fe-45e2-8376-248d99776c00', '2cd363a0-8d5f-4761-96fe-ccdcedddf28b', 'be41e1ee-c4f0-4e1c-8e79-8cac846a975f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (e904359c-f436-45b5-8e96-c611ab06b9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17981b20-fae6-4d84-ac06-8a9d949a5e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17981b20-fae6-4d84-ac06-8a9d949a5e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1243004247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c540b10-727c-42ba-8dfe-b2b4d3197417,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c19b6102-e114-468e-aadc-ba642bcddeca,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:06Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f288fb2-9774-4e91-97be-974381eb11e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f288fb2-9774-4e91-97be-974381eb11e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2db531f-50e7-44d8-8466-f470f631fb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2db531f-50e7-44d8-8466-f470f631fb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1c540b10-727c-42ba-8dfe-b2b4d3197417', 'volume_name': 'volume-1c540b10-727c-42ba-8dfe-b2b4d3197417', 'volume_size': 1, 'source_volid': 'c19b6102-e114-468e-aadc-ba642bcddeca', 'source_volstatus': 'available'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef64030-a194-4922-88a6-ff61ce2fe87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef64030-a194-4922-88a6-ff61ce2fe87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7531cf83-b7a1-4a2f-bc67-1cbf7f325be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:06 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Volume 1c540b10-727c-42ba-8dfe-b2b4d3197417: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1c540b10-727c-42ba-8dfe-b2b4d3197417', 'volume_size': 1, 'source_volid': 'c19b6102-e114-468e-aadc-ba642bcddeca', 'source_volstatus': 'available'}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:06 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Cloning volume c19b6102-e114-468e-aadc-ba642bcddeca to volume 1c540b10-727c-42ba-8dfe-b2b4d3197417
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Creating offline snapshot e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e of volume c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b55d2-4e40-41f5-ac5e-50b94319f0a0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:06 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:06 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:06 devstack sudo[97481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca
Sep 11 06:23:06 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:07 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.293s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:07 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Deleted volume successfully.
Sep 11 06:23:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e6c66ac6-2e01-4614-86fc-b8283bd9bf1f tempest-VolumesActionsTest-861284499 None] Lock "cinder-05344a80-83a6-4fac-9d4c-9be7abae4bb6-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:07 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca" returned: 0 in 0.470s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:07 devstack sudo[97488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e 1G
Sep 11 06:23:07 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:07 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e 1G" returned: 0 in 0.563s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c19b6102-e114-468e-aadc-ba642bcddeca -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:07 devstack sudo[97495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c19b6102-e114-468e-aadc-ba642bcddeca -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e
Sep 11 06:23:07 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:08 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c19b6102-e114-468e-aadc-ba642bcddeca -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:08 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e is being set with open permissions: ugo+rw
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:08 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e
Sep 11 06:23:08 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (38f61f44-4006-441d-804e-62e1b0de3c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a22135-507d-489f-9050-e1e945c5d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a22135-507d-489f-9050-e1e945c5d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-103726475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b381f176-157b-4168-9b4b-1e0800cd8f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:08Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f681c5-b553-4e1e-b423-6d4abf6930ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f681c5-b553-4e1e-b423-6d4abf6930ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493a47cd-7ede-4e9e-b00f-3e63e334c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493a47cd-7ede-4e9e-b00f-3e63e334c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b381f176-157b-4168-9b4b-1e0800cd8f50', 'volume_name': 'volume-b381f176-157b-4168-9b4b-1e0800cd8f50', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdf0526-1480-4d9f-8b03-33b6cf96fb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdf0526-1480-4d9f-8b03-33b6cf96fb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25013927-23bc-4f3c-99d9-9fe640d82545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Volume b381f176-157b-4168-9b4b-1e0800cd8f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b381f176-157b-4168-9b4b-1e0800cd8f50', 'volume_size': 1}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:08 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" returned: 0 in 0.332s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:08 devstack sudo[97503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.info
Sep 11 06:23:08 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:08 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.info" returned: 0 in 0.264s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:08 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.info is being set with open permissions: ugo+rw
Sep 11 06:23:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:08 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.info
Sep 11 06:23:08 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:09 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.info" returned: 0 in 0.279s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-1c540b10-727c-42ba-8dfe-b2b4d3197417" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-1c540b10-727c-42ba-8dfe-b2b4d3197417" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] snapshot: e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e, volume: 1c540b10-727c-42ba-8dfe-b2b4d3197417,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[974e6466-f658-4593-956c-d5882f215b15]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:09 devstack sudo[97509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e
Sep 11 06:23:09 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:09 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" returned: 0 in 0.430s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c19b6102-e114-468e-aadc-ba642bcddeca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63554a6-87f9-4ff0-8f53-63213d581157]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:09 devstack sudo[97515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca
Sep 11 06:23:09 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:10 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca" returned: 0 in 0.398s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:10 devstack sudo[97520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417
Sep 11 06:23:10 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Flow 'volume_create_manager' (3f1186aa-05db-46d3-a7ef-89578d8a0764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc31bf9-4531-4e20-ab4c-e749e872a5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc31bf9-4531-4e20-ab4c-e749e872a5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1918304491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461ca086-fd48-4789-8db6-6697ccb69666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb4a4d7e0c249f6b8bad04d278bab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:10Z,use_quota=True,user_id='6dbe42bf37f442cf83730f70cee260cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c36fa8d-2058-4c8e-bf5b-5bb7ec3dc172),volume_type_id=2c36fa8d-2058-4c8e-bf5b-5bb7ec3dc172)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d842df02-6ed9-4959-88ea-c3253e45a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d842df02-6ed9-4959-88ea-c3253e45a110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b861ba-81da-489d-84d0-2dbab905c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b861ba-81da-489d-84d0-2dbab905c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461ca086-fd48-4789-8db6-6697ccb69666', 'volume_name': 'volume-461ca086-fd48-4789-8db6-6697ccb69666', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eacfc4-307d-4cb1-9497-dc64586393fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eacfc4-307d-4cb1-9497-dc64586393fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12da7b18-ca39-4215-9e59-e4d81b7e0278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume 461ca086-fd48-4789-8db6-6697ccb69666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461ca086-fd48-4789-8db6-6697ccb69666', 'volume_size': 1}
Sep 11 06:23:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Flow 'volume_create_manager' (0b618096-c5aa-4df8-9aaa-a68a30799acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b493bed9-5dcb-4fe8-9fa5-8be7d9875fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b493bed9-5dcb-4fe8-9fa5-8be7d9875fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2006892859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cdea24-9a80-4594-8f00-411d18d0a183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb4a4d7e0c249f6b8bad04d278bab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:12Z,use_quota=True,user_id='6dbe42bf37f442cf83730f70cee260cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf7c216a-b828-4a18-b1e4-3bc0c5053878),volume_type_id=bf7c216a-b828-4a18-b1e4-3bc0c5053878)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8b441e-b54d-48eb-b706-da9568831738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8b441e-b54d-48eb-b706-da9568831738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d1fbe-3b02-4667-8386-864884b2e2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8d1fbe-3b02-4667-8386-864884b2e2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cdea24-9a80-4594-8f00-411d18d0a183', 'volume_name': 'volume-68cdea24-9a80-4594-8f00-411d18d0a183', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bd7d84-91e8-47ed-ac3b-3bbe272c7fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bd7d84-91e8-47ed-ac3b-3bbe272c7fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33c0e20-42ac-4907-a777-758d51f21715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume 68cdea24-9a80-4594-8f00-411d18d0a183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cdea24-9a80-4594-8f00-411d18d0a183', 'volume_size': 1}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Flow 'volume_create_manager' (12ee8995-7ffc-462b-a0aa-11f4b97cbf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b7a76d-ae81-415a-8952-c59b9be37207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b7a76d-ae81-415a-8952-c59b9be37207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1575712714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1197a292-a3a2-4157-86bf-8506236d5845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809f2fcb827432e972353678e10c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:13Z,use_quota=True,user_id='1b77d3d3e9b043699bdc30e3bf72c035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7054a349-90bc-4195-a495-7e9b2879ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7054a349-90bc-4195-a495-7e9b2879ab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211fb03e-2dee-4da0-af05-0e0d99ed22c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211fb03e-2dee-4da0-af05-0e0d99ed22c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1197a292-a3a2-4157-86bf-8506236d5845', 'volume_name': 'volume-1197a292-a3a2-4157-86bf-8506236d5845', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3293ad-11d1-44f9-9e1d-48f179d6d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3293ad-11d1-44f9-9e1d-48f179d6d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b75cb8-3400-4e8b-9c74-175c3bad15c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Volume 1197a292-a3a2-4157-86bf-8506236d5845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1197a292-a3a2-4157-86bf-8506236d5845', 'volume_size': 1}
Sep 11 06:23:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Flow 'volume_create_manager' (032b4599-a9af-427b-8681-de5b7cf62f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c25656-16db-4664-95f7-a46388f4197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c25656-16db-4664-95f7-a46388f4197e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1470681551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b76313-4ee6-4226-9c76-5580bdc5fd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb4a4d7e0c249f6b8bad04d278bab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:13Z,use_quota=True,user_id='6dbe42bf37f442cf83730f70cee260cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(706f8425-eadf-451d-a215-ca8559598328),volume_type_id=706f8425-eadf-451d-a215-ca8559598328)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f512a-0e3f-4869-9718-9dc780741867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f512a-0e3f-4869-9718-9dc780741867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82718a4-7724-45f1-b2a1-d6d910481e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:13 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:23:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82718a4-7724-45f1-b2a1-d6d910481e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3b76313-4ee6-4226-9c76-5580bdc5fd47', 'volume_name': 'volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47', 'volume_size': 1, 'image_id': '2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--131444667', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2fb4a4d7e0c249f6b8bad04d278bab1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'created_at': datetime.datetime(2026, 9, 11, 4, 23, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 23, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030cb42300>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133ebad3-1d1b-4ee3-bd55-675cf7d0b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133ebad3-1d1b-4ee3-bd55-675cf7d0b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fbdf2a-f261-4554-af74-972a5c188419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:14 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume e3b76313-4ee6-4226-9c76-5580bdc5fd47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47', 'volume_size': 1, 'image_id': '2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--131444667', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2fb4a4d7e0c249f6b8bad04d278bab1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'created_at': datetime.datetime(2026, 9, 11, 4, 23, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 23, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030cb42300>}
Sep 11 06:23:14 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Trying to clone e3b76313-4ee6-4226-9c76-5580bdc5fd47 from image 2214e35c-c69e-47e8-bc4c-2b0c0969878a at location (None, [{'url': 'file:///opt/stack/data/glance/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:23:15 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417" returned: 0 in 5.155s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:23:15 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Converted 1024.00 MB image at 198.58 MB/s
Sep 11 06:23:15 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 is being set with open permissions: ugo+rw
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:15 devstack sudo[97534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417
Sep 11 06:23:15 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:15 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417" returned: 0 in 0.261s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-1c540b10-727c-42ba-8dfe-b2b4d3197417" released by "_copy_volume_from_snapshot" :: held 6.320s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Deleting offline snapshot e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e of volume c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] snapshot_file for this snap is: volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eafb0e-9178-47d0-b7be-0e469784d99b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:15 devstack sudo[97537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e
Sep 11 06:23:15 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:15 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" returned: 0 in 0.374s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c19b6102-e114-468e-aadc-ba642bcddeca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33d155-dd2f-4fb5-955b-15a77fd4840c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:16 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca
Sep 11 06:23:16 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:16 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca" returned: 0 in 0.504s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:16 devstack sudo[97547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e
Sep 11 06:23:16 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:16 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" returned: 0 in 0.336s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:16 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e
Sep 11 06:23:16 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:17 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca.e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" returned: 0 in 0.270s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-e9a6974f-e5a2-44a0-a65d-c0eabf0ce67e" released by "_delete_snapshot" :: held 1.571s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.429s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.639s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-103726475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b381f176-157b-4168-9b4b-1e0800cd8f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:08Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Creating volume b381f176-157b-4168-9b4b-1e0800cd8f50 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:17 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7531cf83-b7a1-4a2f-bc67-1cbf7f325be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c540b10-727c-42ba-8dfe-b2b4d3197417', 'volume_size': 1, 'source_volid': 'c19b6102-e114-468e-aadc-ba642bcddeca', 'source_volstatus': 'available'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:17 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50 1073741824
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3524a445-2a7a-4276-8c78-c38485157dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:17 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Volume volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 (1c540b10-727c-42ba-8dfe-b2b4d3197417): created successfully
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3524a445-2a7a-4276-8c78-c38485157dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (e904359c-f436-45b5-8e96-c611ab06b9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3446bdf3-68d4-452c-9719-9a0b86a50c47 tempest-VolumesGetTest-309627119 None] Created volume successfully.
Sep 11 06:23:17 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50 1073741824" returned: 0 in 0.469s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:17 devstack sudo[97561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50
Sep 11 06:23:17 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:17 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.273s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1918304491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461ca086-fd48-4789-8db6-6697ccb69666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb4a4d7e0c249f6b8bad04d278bab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:10Z,use_quota=True,user_id='6dbe42bf37f442cf83730f70cee260cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c36fa8d-2058-4c8e-bf5b-5bb7ec3dc172),volume_type_id=2c36fa8d-2058-4c8e-bf5b-5bb7ec3dc172)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Creating volume 461ca086-fd48-4789-8db6-6697ccb69666 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:17 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25013927-23bc-4f3c-99d9-9fe640d82545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b381f176-157b-4168-9b4b-1e0800cd8f50', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:17 devstack sudo[97565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666 1073741824
Sep 11 06:23:17 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92365891-37b0-494a-b48a-96c2000af6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Volume volume-b381f176-157b-4168-9b4b-1e0800cd8f50 (b381f176-157b-4168-9b4b-1e0800cd8f50): created successfully
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92365891-37b0-494a-b48a-96c2000af6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (38f61f44-4006-441d-804e-62e1b0de3c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-31c29546-6f62-4263-9cd0-d1ce4e15baeb tempest-VolumesActionsTest-1604628463 None] Created volume successfully.
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-b381f176-157b-4168-9b4b-1e0800cd8f50-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Lock "cinder-b381f176-157b-4168-9b4b-1e0800cd8f50-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-quobyte-b381f176-157b-4168-9b4b-1e0800cd8f50" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-b381f176-157b-4168-9b4b-1e0800cd8f50" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[017ff890-224c-4d15-8d81-627d8628efc8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:18 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666 1073741824" returned: 0 in 0.526s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:18 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666
Sep 11 06:23:18 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:18 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50
Sep 11 06:23:18 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD, size 20.69 MB, duration 3.95 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:23:18 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Image download 20.69 MB at 5.24 MB/s
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f337034d-bc9a-4889-9e0b-dbdc76c54cc6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:18 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666" returned: 0 in 0.296s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.378s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2006892859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cdea24-9a80-4594-8f00-411d18d0a183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb4a4d7e0c249f6b8bad04d278bab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:12Z,use_quota=True,user_id='6dbe42bf37f442cf83730f70cee260cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf7c216a-b828-4a18-b1e4-3bc0c5053878),volume_type_id=bf7c216a-b828-4a18-b1e4-3bc0c5053878)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Creating volume 68cdea24-9a80-4594-8f00-411d18d0a183 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:18 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12da7b18-ca39-4215-9e59-e4d81b7e0278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461ca086-fd48-4789-8db6-6697ccb69666', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:18 devstack sudo[97580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183 1073741824
Sep 11 06:23:18 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce687583-10db-4934-94c7-024c5df959d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:18 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50" returned: 0 in 0.442s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:18 devstack sudo[97575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD
Sep 11 06:23:18 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:18 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume volume-461ca086-fd48-4789-8db6-6697ccb69666 (461ca086-fd48-4789-8db6-6697ccb69666): created successfully
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce687583-10db-4934-94c7-024c5df959d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:18 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50
Sep 11 06:23:18 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Flow 'volume_create_manager' (3f1186aa-05db-46d3-a7ef-89578d8a0764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7f26f6f7-3b7d-446b-8713-3f78a0a4ccf4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Created volume successfully.
Sep 11 06:23:19 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Temporary image 2214e35c-c69e-47e8-bc4c-2b0c0969878a is fetched for user 6dbe42bf37f442cf83730f70cee260cc. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:23:19 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b381f176-157b-4168-9b4b-1e0800cd8f50" returned: 0 in 0.362s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-b381f176-157b-4168-9b4b-1e0800cd8f50" released by "delete_volume" :: held 0.858s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (1a0cf1af-4535-44e0-879c-718ee640584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592d03c2-d78d-42bb-8772-f5632e93a1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6edbf-b825-4fd1-b323-8bb8e12a86ab]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:19 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592d03c2-d78d-42bb-8772-f5632e93a1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1547236407',display_name='tempest-VolumesGetTest-Volume-90512442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3e2105-9eed-4b8b-94ad-9afdd6e2e876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:19Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9002e940-0c02-4269-bcb1-6573071282a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9002e940-0c02-4269-bcb1-6573071282a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ca321-5ec2-4bcc-af68-9471e45f7a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ca321-5ec2-4bcc-af68-9471e45f7a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc3e2105-9eed-4b8b-94ad-9afdd6e2e876', 'volume_name': 'volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d00f58d-9871-4da5-88c4-e6586254f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d00f58d-9871-4da5-88c4-e6586254f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cef85c-a2d7-4d79-92e3-47a17ef26efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:19 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Volume cc3e2105-9eed-4b8b-94ad-9afdd6e2e876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876', 'volume_size': 1}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183 1073741824" returned: 0 in 0.620s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Created reservations ['3994a92a-661e-41d7-8d18-a3fb3670a33c', 'ce1b963e-1b9d-4371-a370-171c432053a6', '2261f15d-3bda-4b87-9b47-5353bc678855', '6ad22aa5-249c-475e-a8ea-23e77f26d66a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:19 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD
Sep 11 06:23:19 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:19 devstack sudo[97594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183
Sep 11 06:23:19 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:19 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:19 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:19 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:19 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183" returned: 0 in 0.282s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.771s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1575712714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1197a292-a3a2-4157-86bf-8506236d5845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809f2fcb827432e972353678e10c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:13Z,use_quota=True,user_id='1b77d3d3e9b043699bdc30e3bf72c035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Creating volume 1197a292-a3a2-4157-86bf-8506236d5845 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:19 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:19 devstack sudo[97603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845 1073741824
Sep 11 06:23:19 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33c0e20-42ac-4907-a777-758d51f21715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cdea24-9a80-4594-8f00-411d18d0a183', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dff037a-8df0-4775-b18a-8effa7d70f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:19 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume volume-68cdea24-9a80-4594-8f00-411d18d0a183 (68cdea24-9a80-4594-8f00-411d18d0a183): created successfully
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dff037a-8df0-4775-b18a-8effa7d70f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Flow 'volume_create_manager' (0b618096-c5aa-4df8-9aaa-a68a30799acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-86ed87b0-2ae4-453e-becf-b775fdf9627b tempest-TestInstancesWithCinderVolumes-1683070635 None] Created volume successfully.
Sep 11 06:23:19 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Deleted volume successfully.
Sep 11 06:23:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9c05ff91-dede-4d1c-9863-e00ff9116628 tempest-VolumesActionsTest-861284499 None] Lock "cinder-b381f176-157b-4168-9b4b-1e0800cd8f50-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:20 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845 1073741824" returned: 0 in 0.419s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:20 devstack sudo[97610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845
Sep 11 06:23:20 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:20 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845" returned: 0 in 0.235s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1547236407',display_name='tempest-VolumesGetTest-Volume-90512442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3e2105-9eed-4b8b-94ad-9afdd6e2e876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:19Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Creating volume cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:20 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b75cb8-3400-4e8b-9c74-175c3bad15c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1197a292-a3a2-4157-86bf-8506236d5845', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:20 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 1073741824
Sep 11 06:23:20 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d27d1fa-2ab8-406f-9aa2-adacaab2044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:20 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Volume volume-1197a292-a3a2-4157-86bf-8506236d5845 (1197a292-a3a2-4157-86bf-8506236d5845): created successfully
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d27d1fa-2ab8-406f-9aa2-adacaab2044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Flow 'volume_create_manager' (12ee8995-7ffc-462b-a0aa-11f4b97cbf88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-518c6a0e-7f43-4006-ae49-5ee5f067e9d6 tempest-VolumesTransfersTest-275827570 None] Created volume successfully.
Sep 11 06:23:21 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 1073741824" returned: 0 in 0.564s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:21 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876
Sep 11 06:23:21 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (91695b68-5f54-4420-aae3-1dc296d791f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d49ecf-330c-4d79-8332-b9bd333a83b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d49ecf-330c-4d79-8332-b9bd333a83b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-963706215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3634a97b-f63a-448c-b726-4f50dc4854e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:21Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe292c6-9b9c-43af-99f5-81ceebcedf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe292c6-9b9c-43af-99f5-81ceebcedf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3965e9d-1618-418b-be98-3a8aac4da7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3965e9d-1618-418b-be98-3a8aac4da7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3634a97b-f63a-448c-b726-4f50dc4854e4', 'volume_name': 'volume-3634a97b-f63a-448c-b726-4f50dc4854e4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fb34c8-e34a-4a98-a2b1-93ca4cd1befb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fb34c8-e34a-4a98-a2b1-93ca4cd1befb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f787388-8f3f-410d-88f7-f8c7b2258a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:21 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Volume 3634a97b-f63a-448c-b726-4f50dc4854e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3634a97b-f63a-448c-b726-4f50dc4854e4', 'volume_size': 1}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:21 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876" returned: 0 in 0.274s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1470681551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b76313-4ee6-4226-9c76-5580bdc5fd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb4a4d7e0c249f6b8bad04d278bab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:13Z,use_quota=True,user_id='6dbe42bf37f442cf83730f70cee260cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(706f8425-eadf-451d-a215-ca8559598328),volume_type_id=706f8425-eadf-451d-a215-ca8559598328)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Creating volume e3b76313-4ee6-4226-9c76-5580bdc5fd47 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:21 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cef85c-a2d7-4d79-92e3-47a17ef26efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:21 devstack sudo[97621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 1073741824
Sep 11 06:23:21 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c2bdee-a6b0-45e9-9c88-97187d0de415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:21 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Volume volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 (cc3e2105-9eed-4b8b-94ad-9afdd6e2e876): created successfully
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c2bdee-a6b0-45e9-9c88-97187d0de415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (1a0cf1af-4535-44e0-879c-718ee640584d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-beb1feb4-60ff-495b-b03d-0331e1ec56d3 tempest-VolumesGetTest-309627119 None] Created volume successfully.
Sep 11 06:23:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2f9c7f4e-9cf0-40dc-9b68-440d98b8ff86 tempest-VolumesTransfersTest-635865940 None] Transfer volume completed successfully.
Sep 11 06:23:21 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 1073741824" returned: 0 in 0.465s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:21 devstack sudo[97627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47
Sep 11 06:23:21 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Acquiring lock "cinder-1197a292-a3a2-4157-86bf-8506236d5845-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:22 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47" returned: 0 in 0.266s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-963706215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3634a97b-f63a-448c-b726-4f50dc4854e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:21Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Creating volume 3634a97b-f63a-448c-b726-4f50dc4854e4 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:22 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-1197a292-a3a2-4157-86bf-8506236d5845-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:22 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4 1073741824
Sep 11 06:23:22 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Attempting download of 2214e35c-c69e-47e8-bc4c-2b0c0969878a ((None, [{'url': 'file:///opt/stack/data/glance/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'metadata': {}}])) to volume e3b76313-4ee6-4226-9c76-5580bdc5fd47. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Acquiring lock "cinder-quobyte-1197a292-a3a2-4157-86bf-8506236d5845" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-quobyte-1197a292-a3a2-4157-86bf-8506236d5845" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e918397-c65e-440b-8a46-91596a821921]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2214e35c-c69e-47e8-bc4c-2b0c0969878a_zpqqpabt {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e2c61-dbe0-4a31-ae50-1805e05d32a8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:22 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2214e35c-c69e-47e8-bc4c-2b0c0969878a_zpqqpabt
Sep 11 06:23:22 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:22 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845
Sep 11 06:23:22 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Lock "cinder-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[83346c89-d281-4e3d-b223-d63ce520d2a0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:22 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4 1073741824" returned: 0 in 0.570s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:22 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2214e35c-c69e-47e8-bc4c-2b0c0969878a_zpqqpabt" returned: 0 in 0.460s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2214e35c-c69e-47e8-bc4c-2b0c0969878a_zpqqpabt {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:22 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845" returned: 0 in 0.474s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:22 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876
Sep 11 06:23:22 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:22 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845
Sep 11 06:23:22 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:22 devstack sudo[97649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4
Sep 11 06:23:22 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:22 devstack sudo[97647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2214e35c-c69e-47e8-bc4c-2b0c0969878a_zpqqpabt
Sep 11 06:23:22 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:23 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876" returned: 0 in 0.380s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4" returned: 0 in 0.286s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:23 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876
Sep 11 06:23:23 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:23 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1197a292-a3a2-4157-86bf-8506236d5845" returned: 0 in 0.318s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2214e35c-c69e-47e8-bc4c-2b0c0969878a_zpqqpabt" returned: 1 in 0.356s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2214e35c-c69e-47e8-bc4c-2b0c0969878a_zpqqpabt' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-quobyte-1197a292-a3a2-4157-86bf-8506236d5845" released by "delete_volume" :: held 0.862s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9da7a7-152c-4d20-b51c-6203d42a4615]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f787388-8f3f-410d-88f7-f8c7b2258a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3634a97b-f63a-448c-b726-4f50dc4854e4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb60a316-eed2-47d5-b86e-0b2a50ce4434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:23 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Volume volume-3634a97b-f63a-448c-b726-4f50dc4854e4 (3634a97b-f63a-448c-b726-4f50dc4854e4): created successfully
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb60a316-eed2-47d5-b86e-0b2a50ce4434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (91695b68-5f54-4420-aae3-1dc296d791f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2112d5b8-f8ac-4e53-ad62-22894d198017 tempest-VolumesActionsTest-1604628463 None] Created volume successfully.
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Created reservations ['2dfa120a-c03d-48e8-9e8b-a912a86d77d7', '06717da7-e0f9-49b8-8a08-32bf0442caf3', '8ee116f7-cf65-486c-add4-1253032b2371', 'c5e6da6f-d533-4687-b305-67a019c7d57a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:23 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD
Sep 11 06:23:23 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:23 devstack sudo[97667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:23 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:23 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876" returned: 0 in 0.309s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876" released by "delete_volume" :: held 0.730s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Created reservations ['8aa88c43-e55a-4d90-ac93-fb9b170271f0', '78f924d9-65ae-4fd0-9432-b0bd732c12ce', 'e320ffc1-df4e-4103-b3e0-9b820169af60', 'ea73e2df-075c-4e39-b2b4-089d11953118'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:23 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] 2214e35c-c69e-47e8-bc4c-2b0c0969878a was qcow2, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:23 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47
Sep 11 06:23:23 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:23 devstack sudo[97674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:23 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:23 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.271s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Deleted volume successfully.
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ac5e4d49-fa67-47a0-988e-4b7c7acd78a2 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-1197a292-a3a2-4157-86bf-8506236d5845-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-1c540b10-727c-42ba-8dfe-b2b4d3197417-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:23 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.281s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Lock "cinder-1c540b10-727c-42ba-8dfe-b2b4d3197417-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Deleted volume successfully.
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78788fc4-8b5a-4935-a7a5-7d88a274fee3 tempest-VolumesGetTest-309627119 None] Lock "cinder-cc3e2105-9eed-4b8b-94ad-9afdd6e2e876-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-1c540b10-727c-42ba-8dfe-b2b4d3197417" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-1c540b10-727c-42ba-8dfe-b2b4d3197417" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d8998-badc-4e99-b849-65a0748600f7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:23 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417
Sep 11 06:23:23 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:24 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417" returned: 0 in 0.404s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:24 devstack sudo[97703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417
Sep 11 06:23:24 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-3634a97b-f63a-448c-b726-4f50dc4854e4-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Lock "cinder-3634a97b-f63a-448c-b726-4f50dc4854e4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-quobyte-3634a97b-f63a-448c-b726-4f50dc4854e4" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-3634a97b-f63a-448c-b726-4f50dc4854e4" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f662f446-4bd9-483a-b70d-1686e626387a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:24 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1c540b10-727c-42ba-8dfe-b2b4d3197417" returned: 0 in 0.406s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-1c540b10-727c-42ba-8dfe-b2b4d3197417" released by "delete_volume" :: held 0.853s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Created reservations ['fac0b935-a795-4c32-a29b-25b880c68c91', '405681e2-e7b0-492a-8511-eb0c7157b72c', 'bab79b94-87a6-4ba1-b0c9-9d0a9590f52b', '87f7b8ea-fc97-4a3b-b53f-29a07483e617'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:24 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4
Sep 11 06:23:24 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:24 devstack sudo[97730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:24 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-c19b6102-e114-468e-aadc-ba642bcddeca-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Lock "cinder-c19b6102-e114-468e-aadc-ba642bcddeca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:25 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-c19b6102-e114-468e-aadc-ba642bcddeca" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.347s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Deleted volume successfully.
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-c19b6102-e114-468e-aadc-ba642bcddeca" acquired by "delete_volume" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:25 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4" returned: 0 in 0.703s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3c341-7837-4871-a3e7-6f83b6682ff2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-21015573-8039-4e37-8453-7a8134ad8da7 tempest-VolumesGetTest-309627119 None] Lock "cinder-1c540b10-727c-42ba-8dfe-b2b4d3197417-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:25 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4
Sep 11 06:23:25 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Flow 'volume_create_manager' (9b96ef66-bcd8-4c78-88e4-bbe478381ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fa2ca4-d5df-4a3a-aedf-e52ab985559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fa2ca4-d5df-4a3a-aedf-e52ab985559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1578174001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689ad847-7401-4779-8624-490ba1089abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809f2fcb827432e972353678e10c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:25Z,use_quota=True,user_id='1b77d3d3e9b043699bdc30e3bf72c035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce7d6fb-6fcc-4a34-b1b9-1ef6af95a99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce7d6fb-6fcc-4a34-b1b9-1ef6af95a99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722ba6f1-7b4a-45d9-afff-721c369cbafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:25 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca
Sep 11 06:23:25 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722ba6f1-7b4a-45d9-afff-721c369cbafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '689ad847-7401-4779-8624-490ba1089abe', 'volume_name': 'volume-689ad847-7401-4779-8624-490ba1089abe', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef681df-fd07-45d8-bcca-c8d366a1973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef681df-fd07-45d8-bcca-c8d366a1973f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9ea3e7-36a9-44b6-9685-5eecc4bc8506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:25 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Volume 689ad847-7401-4779-8624-490ba1089abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-689ad847-7401-4779-8624-490ba1089abe', 'volume_size': 1}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1578174001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689ad847-7401-4779-8624-490ba1089abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a809f2fcb827432e972353678e10c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:25Z,use_quota=True,user_id='1b77d3d3e9b043699bdc30e3bf72c035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Creating volume 689ad847-7401-4779-8624-490ba1089abe {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:25 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:25 devstack sudo[97741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe 1073741824
Sep 11 06:23:25 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:25 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47" returned: 0 in 2.190s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2214e35c-c69e-47e8-bc4c-2b0c0969878a_oprt0d_vdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:23:25 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Converted 112.00 MB image at 51.12 MB/s
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:25 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3634a97b-f63a-448c-b726-4f50dc4854e4" returned: 0 in 0.330s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:25 devstack sudo[97744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 1G
Sep 11 06:23:25 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-3634a97b-f63a-448c-b726-4f50dc4854e4" released by "delete_volume" :: held 1.094s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:25 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Created reservations ['1428d1ba-0cc2-42af-80ff-c506b2bd9ca3', 'b911c9fd-4cdc-41dd-96c3-ecbc587b0887', '808df443-cc55-40cb-b523-8691495f12e0', '5e246b51-b3e5-432b-b0d2-5aa31ad66109'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca" returned: 0 in 0.496s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:25 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca
Sep 11 06:23:25 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:26 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:26 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:26 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 1G" returned: 0 in 0.392s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Downloaded image 2214e35c-c69e-47e8-bc4c-2b0c0969878a ((None, [{'url': 'file:///opt/stack/data/glance/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'metadata': {}}])) to volume e3b76313-4ee6-4226-9c76-5580bdc5fd47 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Temporary image 2214e35c-c69e-47e8-bc4c-2b0c0969878a for user 6dbe42bf37f442cf83730f70cee260cc is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Marking volume e3b76313-4ee6-4226-9c76-5580bdc5fd47 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Copying metadata from image 2214e35c-c69e-47e8-bc4c-2b0c0969878a to e3b76313-4ee6-4226-9c76-5580bdc5fd47. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Creating volume glance metadata for volume e3b76313-4ee6-4226-9c76-5580bdc5fd47 backed by image 2214e35c-c69e-47e8-bc4c-2b0c0969878a with: {'image_id': '2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'image_name': 'tempest-scenario-img--131444667', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:23:26 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fbdf2a-f261-4554-af74-972a5c188419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47', 'volume_size': 1, 'image_id': '2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--131444667', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2fb4a4d7e0c249f6b8bad04d278bab1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2214e35c-c69e-47e8-bc4c-2b0c0969878a', 'created_at': datetime.datetime(2026, 9, 11, 4, 23, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 23, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2214e35c-c69e-47e8-bc4c-2b0c0969878a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030cb42300>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15be168-f453-4a71-9b3a-a7d8c96e7485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe 1073741824" returned: 0 in 0.600s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:26 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c19b6102-e114-468e-aadc-ba642bcddeca" returned: 0 in 0.291s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:26 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Volume volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 (e3b76313-4ee6-4226-9c76-5580bdc5fd47): created successfully
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15be168-f453-4a71-9b3a-a7d8c96e7485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Flow 'volume_create_manager' (032b4599-a9af-427b-8681-de5b7cf62f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-c19b6102-e114-468e-aadc-ba642bcddeca" released by "delete_volume" :: held 0.924s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-079cd776-5c7a-4481-b103-0127b15f722f tempest-TestInstancesWithCinderVolumes-1683070635 None] Created volume successfully.
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:26 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:26 devstack sudo[97765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe
Sep 11 06:23:26 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.312s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Deleted volume successfully.
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Created reservations ['48cb0632-9ecb-4b42-913f-d571442995d7', 'd8ae3530-c284-4f78-9dc3-4eb280917acf', '6af3284c-2725-4068-a053-287a22549693', '069afdd2-9ec8-4b31-abd4-adf4225085e8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0335e8c7-92be-418b-9ce7-6154fc26bacf tempest-VolumesActionsTest-861284499 None] Lock "cinder-3634a97b-f63a-448c-b726-4f50dc4854e4-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:26 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:26 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:26 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe" returned: 0 in 0.303s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9ea3e7-36a9-44b6-9685-5eecc4bc8506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689ad847-7401-4779-8624-490ba1089abe', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a81707a-f2e8-4c20-9116-a21ee033a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:26 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Volume volume-689ad847-7401-4779-8624-490ba1089abe (689ad847-7401-4779-8624-490ba1089abe): created successfully
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a81707a-f2e8-4c20-9116-a21ee033a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Flow 'volume_create_manager' (9b96ef66-bcd8-4c78-88e4-bbe478381ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5ff5a131-9213-49e5-93af-0ee04cc4fe11 tempest-VolumesTransfersTest-275827570 None] Created volume successfully.
Sep 11 06:23:26 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.265s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Deleted volume successfully.
Sep 11 06:23:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b4a1ed22-8f18-441a-93ed-5e4ed42b2f3a tempest-VolumesGetTest-309627119 None] Lock "cinder-c19b6102-e114-468e-aadc-ba642bcddeca-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (090b52ec-909f-46a3-a29f-48d5d2f2aa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af734466-1ba6-4295-b300-7537759309aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af734466-1ba6-4295-b300-7537759309aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1924777156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe980941-e63e-49f8-9dfd-f133f3741ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:27Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f34522e-adde-48f1-944b-e602c21f07ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f34522e-adde-48f1-944b-e602c21f07ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f384b7c8-748f-49a2-ad3a-80c130e9f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f384b7c8-748f-49a2-ad3a-80c130e9f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe980941-e63e-49f8-9dfd-f133f3741ebd', 'volume_name': 'volume-fe980941-e63e-49f8-9dfd-f133f3741ebd', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885da302-de7b-4bf4-aae7-7f9b16f46c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885da302-de7b-4bf4-aae7-7f9b16f46c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ebdc35-751a-4f00-a7b2-1ad18ef3019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:27 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Volume fe980941-e63e-49f8-9dfd-f133f3741ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe980941-e63e-49f8-9dfd-f133f3741ebd', 'volume_size': 1}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1924777156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe980941-e63e-49f8-9dfd-f133f3741ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:27Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Creating volume fe980941-e63e-49f8-9dfd-f133f3741ebd {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:27 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:27 devstack sudo[97771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd 1073741824
Sep 11 06:23:27 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Acquiring lock "cinder-689ad847-7401-4779-8624-490ba1089abe-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-689ad847-7401-4779-8624-490ba1089abe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Acquiring lock "cinder-quobyte-689ad847-7401-4779-8624-490ba1089abe" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-quobyte-689ad847-7401-4779-8624-490ba1089abe" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[25782f23-e45d-4ffd-8bc0-00233e6e652c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:28 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe
Sep 11 06:23:28 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:28 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd 1073741824" returned: 0 in 0.823s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:28 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd
Sep 11 06:23:28 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:28 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (e3d684eb-7ccd-4727-9633-d4b76bbe022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e01228-f4dd-4639-8064-9a7319160a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe" returned: 0 in 0.592s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e01228-f4dd-4639-8064-9a7319160a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1386443267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:28Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:28 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a024cc2-eb7e-4148-a783-9c723b45993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:28 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe
Sep 11 06:23:28 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a024cc2-eb7e-4148-a783-9c723b45993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b8cae4-0e86-4b6c-98c2-bb7db329c3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd" returned: 0 in 0.360s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ebdc35-751a-4f00-a7b2-1ad18ef3019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe980941-e63e-49f8-9dfd-f133f3741ebd', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905d8b8-90dc-45e8-a947-48386a47fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:28 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Volume volume-fe980941-e63e-49f8-9dfd-f133f3741ebd (fe980941-e63e-49f8-9dfd-f133f3741ebd): created successfully
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905d8b8-90dc-45e8-a947-48386a47fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (090b52ec-909f-46a3-a29f-48d5d2f2aa47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-605b6676-8ba3-46e6-9208-599fe0d3064c tempest-VolumesActionsTest-1604628463 None] Created volume successfully.
Sep 11 06:23:28 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-689ad847-7401-4779-8624-490ba1089abe" returned: 0 in 0.286s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-quobyte-689ad847-7401-4779-8624-490ba1089abe" released by "delete_volume" :: held 0.945s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b8cae4-0e86-4b6c-98c2-bb7db329c3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5', 'volume_name': 'volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316f2e600>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370929b4-33be-4052-8350-1da8f43b0dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370929b4-33be-4052-8350-1da8f43b0dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8720211-6d48-4993-9bc4-e86d06cfd845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:28 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Volume a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316f2e600>}
Sep 11 06:23:28 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Trying to clone a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Created reservations ['6d18e11b-6199-462c-afc1-1a463c35cadf', '049dac51-ed36-43b6-8915-8cedd8683de7', '47ec7e87-b77c-4d43-8367-d01eff57d018', '19f9fd55-ac73-46a9-9110-a16121e8747a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:29 devstack sudo[97791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:29 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:23:29 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee9a4e7-62b1-45d1-b2f8-19a49314175c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:29 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.472s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Deleted volume successfully.
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10eb9923-912e-4530-a53b-a34cb05d5042 tempest-VolumesTransfersTest-1420213422 None] Lock "cinder-689ad847-7401-4779-8624-490ba1089abe-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:29 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD
Sep 11 06:23:29 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-fe980941-e63e-49f8-9dfd-f133f3741ebd-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Lock "cinder-fe980941-e63e-49f8-9dfd-f133f3741ebd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-787e0886-608c-498b-b322-e58ec059db2f req-e56457b3-3c0a-429f-a933-d13df51ceccb tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-787e0886-608c-498b-b322-e58ec059db2f req-e56457b3-3c0a-429f-a933-d13df51ceccb tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-787e0886-608c-498b-b322-e58ec059db2f req-e56457b3-3c0a-429f-a933-d13df51ceccb tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Acquiring lock "cinder-quobyte-fe980941-e63e-49f8-9dfd-f133f3741ebd" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-787e0886-608c-498b-b322-e58ec059db2f req-e56457b3-3c0a-429f-a933-d13df51ceccb tempest-TestInstancesWithCinderVolumes-1683070635 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5eae8d6-5a4d-4f59-b0fd-e9ec03770ec5', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-fe980941-e63e-49f8-9dfd-f133f3741ebd" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9680c5-0f9d-4ad4-b5b5-24ec9b956e37]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-787e0886-608c-498b-b322-e58ec059db2f req-e56457b3-3c0a-429f-a933-d13df51ceccb tempest-TestInstancesWithCinderVolumes-1683070635 None] attachment_update completed successfully.
Sep 11 06:23:30 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 is fetched for user af2c5cb76a8f49b992122ae4453c6ac8. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:23:30 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd
Sep 11 06:23:30 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34fa983-d292-4db7-81a7-d590263c69fc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:30 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD
Sep 11 06:23:30 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:30 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd" returned: 0 in 0.715s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:30 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd
Sep 11 06:23:30 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:30 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1386443267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:28Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Creating volume a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:30 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:30 devstack sudo[97823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 1073741824
Sep 11 06:23:30 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:30 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-fe980941-e63e-49f8-9dfd-f133f3741ebd" returned: 0 in 0.318s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Lock "cinder-quobyte-fe980941-e63e-49f8-9dfd-f133f3741ebd" released by "delete_volume" :: held 1.087s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Created reservations ['a8349170-49b7-441d-a1ff-efc432c6d0f9', '792457ef-f7bc-41cb-9e93-79d3cdfb5be9', '1c0f3240-722c-4cd9-8bae-879fedb6c7e4', 'cef029b4-0d84-42b8-97bd-a48cdef6c325'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:31 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:31 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:31 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:31 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:31 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 1073741824" returned: 0 in 0.655s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:31 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.346s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:31 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Deleted volume successfully.
Sep 11 06:23:31 devstack sudo[97836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5
Sep 11 06:23:31 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:31 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c745be7-3b99-4ac0-9253-b033c4c68067 tempest-VolumesActionsTest-861284499 None] Lock "cinder-fe980941-e63e-49f8-9dfd-f133f3741ebd-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.429s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:23:31 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5" returned: 0 in 0.337s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Attempting download of 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae1ca8-c10d-41a6-818b-29d84464e3fe]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_wh63au8a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:32 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_wh63au8a
Sep 11 06:23:32 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:32 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_wh63au8a" returned: 0 in 0.456s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_wh63au8a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:32 devstack sudo[97846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_wh63au8a
Sep 11 06:23:32 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (0be8529f-5599-440e-8df5-9f402cbbce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5a1e9c-aa9b-4ebd-aa84-f25e2b0f8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5a1e9c-aa9b-4ebd-aa84-f25e2b0f8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-101910100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6757c44d-9e8f-4349-9993-94bf03fff5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:33Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46207341-87cf-4ea9-b62a-3ec9341432bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46207341-87cf-4ea9-b62a-3ec9341432bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d717d32-b3b5-4ba3-8d73-c256c0317944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d717d32-b3b5-4ba3-8d73-c256c0317944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6757c44d-9e8f-4349-9993-94bf03fff5c5', 'volume_name': 'volume-6757c44d-9e8f-4349-9993-94bf03fff5c5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef76ee5-635c-4054-ae2c-4d50a710e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef76ee5-635c-4054-ae2c-4d50a710e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9690f6-2db6-4150-8cc9-8be266cf0d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Volume 6757c44d-9e8f-4349-9993-94bf03fff5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6757c44d-9e8f-4349-9993-94bf03fff5c5', 'volume_size': 1}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-101910100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6757c44d-9e8f-4349-9993-94bf03fff5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c8ab16313d4d449f03261159861e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:33Z,use_quota=True,user_id='03af134fab984373b85bf4acb065cf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Creating volume 6757c44d-9e8f-4349-9993-94bf03fff5c5 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:33 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:33 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_wh63au8a" returned: 1 in 0.654s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_wh63au8a' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb5cfd-6e77-4261-b6f8-063c9dd2a994]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:33 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5 1073741824
Sep 11 06:23:33 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:33 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD
Sep 11 06:23:33 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:33 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] 02c3cc94-2cbe-438e-96aa-813e3f248ce8 was qcow2, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:23:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:33 devstack sudo[98282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5
Sep 11 06:23:33 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:34 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5 1073741824" returned: 0 in 1.035s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:34 devstack sudo[98308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5
Sep 11 06:23:34 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:34 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5" returned: 0 in 0.342s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9690f6-2db6-4150-8cc9-8be266cf0d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6757c44d-9e8f-4349-9993-94bf03fff5c5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4421cbf3-7221-4ae6-b386-8a8753ce83c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:34 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Volume volume-6757c44d-9e8f-4349-9993-94bf03fff5c5 (6757c44d-9e8f-4349-9993-94bf03fff5c5): created successfully
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4421cbf3-7221-4ae6-b386-8a8753ce83c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Flow 'volume_create_manager' (0be8529f-5599-440e-8df5-9f402cbbce90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f50f1837-9349-46e7-b4ae-28a167bd15c5 tempest-VolumesActionsTest-1604628463 None] Created volume successfully.
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "cinder-6757c44d-9e8f-4349-9993-94bf03fff5c5-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-6757c44d-9e8f-4349-9993-94bf03fff5c5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "cinder-quobyte-6757c44d-9e8f-4349-9993-94bf03fff5c5" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-quobyte-6757c44d-9e8f-4349-9993-94bf03fff5c5" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd22f8-28e2-499d-8376-f527a5a674ce]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:36 devstack sudo[98319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5
Sep 11 06:23:36 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:36 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5" returned: 0 in 3.021s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_81zrs4eadevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:23:36 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Converted 112.00 MB image at 37.05 MB/s
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:36 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 1G
Sep 11 06:23:36 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5" returned: 0 in 0.572s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:36 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:36 devstack sudo[98327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5
Sep 11 06:23:36 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:37 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6757c44d-9e8f-4349-9993-94bf03fff5c5" returned: 0 in 0.377s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-quobyte-6757c44d-9e8f-4349-9993-94bf03fff5c5" released by "delete_volume" :: held 1.029s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Created reservations ['480c97f1-e460-46b3-b524-4a35c2cca2d5', '23a62d2d-cb54-4495-b0a6-c7e2a70e8603', 'f90e70c9-9b31-4c0a-917c-fe12723591bb', '39cc4293-202a-4cac-ab0c-7661e3f781aa'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:37 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 1G" returned: 0 in 0.675s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Downloaded image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 for user af2c5cb76a8f49b992122ae4453c6ac8 is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Marking volume a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Copying metadata from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 to a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Creating volume glance metadata for volume a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 backed by image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:37 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:37 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8720211-6d48-4993-9bc4-e86d06cfd845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316f2e600>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1482a9b6-5781-4be3-9573-d4f0cf452abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:37 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Volume volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 (a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5): created successfully
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1482a9b6-5781-4be3-9573-d4f0cf452abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (e3d684eb-7ccd-4727-9633-d4b76bbe022b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3b60bf65-2df4-4608-86f0-a02523cab5a8 tempest-VolumesGetTest-309627119 None] Created volume successfully.
Sep 11 06:23:37 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.338s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:37 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Deleted volume successfully.
Sep 11 06:23:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-28a42188-4372-46b7-97ad-a48d629a8b83 tempest-VolumesActionsTest-1604628463 None] Lock "cinder-6757c44d-9e8f-4349-9993-94bf03fff5c5-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=185,cinder:SELECT=133,cinder:INSERT=66,cinder:DELETE=22 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=170,cinder:INSERT=52,cinder:UPDATE=192,cinder:DELETE=12 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (bceebd42-8432-4651-91c5-7cc0cf729bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a1a951-e633-4ef8-93c7-19e013d416c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a1a951-e633-4ef8-93c7-19e013d416c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-354106631',display_name='tempest-VolumesGetTest-Volume-347356860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05774c33-8859-4a9b-a7b5-648ce048c1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:40Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676742d6-edf3-42ef-9574-9dfc1e2e24d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676742d6-edf3-42ef-9574-9dfc1e2e24d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35912e59-9b9e-448e-b80e-598c3d2684c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35912e59-9b9e-448e-b80e-598c3d2684c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05774c33-8859-4a9b-a7b5-648ce048c1c0', 'volume_name': 'volume-05774c33-8859-4a9b-a7b5-648ce048c1c0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb96f7b2-a0ef-4e78-bd0d-e665d9b7727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb96f7b2-a0ef-4e78-bd0d-e665d9b7727f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a2d7de-76a0-4d4a-9f9c-3e5b55882404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:40 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Volume 05774c33-8859-4a9b-a7b5-648ce048c1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05774c33-8859-4a9b-a7b5-648ce048c1c0', 'volume_size': 1}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-354106631',display_name='tempest-VolumesGetTest-Volume-347356860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05774c33-8859-4a9b-a7b5-648ce048c1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58b62a004a9471fa3849c5357e50864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:40Z,use_quota=True,user_id='af2c5cb76a8f49b992122ae4453c6ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Creating volume 05774c33-8859-4a9b-a7b5-648ce048c1c0 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:40 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:40 devstack sudo[98338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0 1073741824
Sep 11 06:23:40 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:41 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0 1073741824" returned: 0 in 1.033s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:41 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0
Sep 11 06:23:41 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:41 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0" returned: 0 in 0.417s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a2d7de-76a0-4d4a-9f9c-3e5b55882404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05774c33-8859-4a9b-a7b5-648ce048c1c0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e17f34-bfe4-4a02-8076-170c28b22e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:41 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Volume volume-05774c33-8859-4a9b-a7b5-648ce048c1c0 (05774c33-8859-4a9b-a7b5-648ce048c1c0): created successfully
Sep 11 06:23:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e17f34-bfe4-4a02-8076-170c28b22e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Flow 'volume_create_manager' (bceebd42-8432-4651-91c5-7cc0cf729bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9a74e1f2-606a-4657-9e7b-8150622aad8a tempest-VolumesGetTest-309627119 None] Created volume successfully.
Sep 11 06:23:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-05774c33-8859-4a9b-a7b5-648ce048c1c0-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Lock "cinder-05774c33-8859-4a9b-a7b5-648ce048c1c0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-05774c33-8859-4a9b-a7b5-648ce048c1c0" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-05774c33-8859-4a9b-a7b5-648ce048c1c0" acquired by "delete_volume" :: waited 0.038s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:42 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7190b0-315c-4d19-83db-bf51dd5b0f7a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:43 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0
Sep 11 06:23:43 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:43 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0" returned: 0 in 0.654s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:43 devstack sudo[98355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0
Sep 11 06:23:43 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:43 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05774c33-8859-4a9b-a7b5-648ce048c1c0" returned: 0 in 0.526s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-05774c33-8859-4a9b-a7b5-648ce048c1c0" released by "delete_volume" :: held 1.247s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Created reservations ['9ce945a8-aaab-4552-8cee-c3e808dd3e0e', '50946513-ba38-49fd-a559-e1e1a905f225', '44734738-78d7-4947-a98c-294c6018990f', '6a3d7e8b-96f2-48d5-999e-eaf3f3381a1a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:44 devstack sudo[98364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:44 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:44 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.465s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:44 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Deleted volume successfully.
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-13d9e00b-d767-4a86-8cd7-7dbe561c8364 tempest-VolumesGetTest-309627119 None] Lock "cinder-05774c33-8859-4a9b-a7b5-648ce048c1c0-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:44 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Flow 'volume_create_manager' (ced1ab60-830e-4418-b366-c4c6358755c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b4c86f-a767-471d-bfca-2f0f74680a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b4c86f-a767-471d-bfca-2f0f74680a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384232026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768763f5-4e16-4e1a-8857-f0cd60d2c092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdadc2f05cad4cb09bcc4dd60f266e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:45Z,use_quota=True,user_id='97cce9a382e94588a0c10f981291139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60d6b3f-6d3f-47c0-8761-77a47af4d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60d6b3f-6d3f-47c0-8761-77a47af4d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86910d35-0cfb-4355-957f-4b4292bc74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86910d35-0cfb-4355-957f-4b4292bc74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768763f5-4e16-4e1a-8857-f0cd60d2c092', 'volume_name': 'volume-768763f5-4e16-4e1a-8857-f0cd60d2c092', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4789ae43-2495-46ef-9917-1224eec305b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4789ae43-2495-46ef-9917-1224eec305b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07cd147-ebf7-44a7-8e5a-b00c13cd5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Volume 768763f5-4e16-4e1a-8857-f0cd60d2c092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768763f5-4e16-4e1a-8857-f0cd60d2c092', 'volume_size': 1}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384232026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768763f5-4e16-4e1a-8857-f0cd60d2c092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdadc2f05cad4cb09bcc4dd60f266e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:45Z,use_quota=True,user_id='97cce9a382e94588a0c10f981291139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Creating volume 768763f5-4e16-4e1a-8857-f0cd60d2c092 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:45 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:45 devstack sudo[98367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092 1073741824
Sep 11 06:23:45 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Lock "cinder-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Acquiring lock "cinder-quobyte-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5" acquired by "delete_volume" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed01335a-a526-49dd-be7c-064819356be9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:45 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5
Sep 11 06:23:45 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:45 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092 1073741824" returned: 0 in 0.758s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:45 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092
Sep 11 06:23:45 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:46 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5" returned: 0 in 0.733s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:46 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:46 devstack sudo[98381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5
Sep 11 06:23:46 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092" returned: 0 in 0.329s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07cd147-ebf7-44a7-8e5a-b00c13cd5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768763f5-4e16-4e1a-8857-f0cd60d2c092', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e56327e-70f4-4177-a2b9-e7f7250eb180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:46 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Volume volume-768763f5-4e16-4e1a-8857-f0cd60d2c092 (768763f5-4e16-4e1a-8857-f0cd60d2c092): created successfully
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e56327e-70f4-4177-a2b9-e7f7250eb180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Flow 'volume_create_manager' (ced1ab60-830e-4418-b366-c4c6358755c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f5e0981f-9196-4330-9a07-feb466931385 tempest-VolumesTransfersV355Test-1334326225 None] Created volume successfully.
Sep 11 06:23:46 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5" returned: 0 in 0.578s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Lock "cinder-quobyte-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5" released by "delete_volume" :: held 1.446s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Created reservations ['0dc54c44-2398-4b91-9881-3a74ea962af3', 'f627044d-7449-44c9-bdc0-24fa29f5a2a9', 'fd1bf5f1-66a9-453d-81cb-05426d6fec92', '57707ae2-1203-4447-b3c2-3627f440c4fb'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:47 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:47 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:47 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.701s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:47 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Deleted volume successfully.
Sep 11 06:23:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c8a6a9f-851f-42f3-8a8c-fc1f9545784a tempest-VolumesGetTest-309627119 None] Lock "cinder-a5c6a3be-de21-4d6b-81c3-609fc3a7a5f5-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ec91c227-8666-416b-ab3d-3c3753b5468d tempest-VolumesTransfersV355Test-111693473 None] Transfer volume completed successfully.
Sep 11 06:23:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Acquiring lock "cinder-768763f5-4e16-4e1a-8857-f0cd60d2c092-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-768763f5-4e16-4e1a-8857-f0cd60d2c092-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Acquiring lock "cinder-quobyte-768763f5-4e16-4e1a-8857-f0cd60d2c092" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-quobyte-768763f5-4e16-4e1a-8857-f0cd60d2c092" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[430325d9-6655-459c-9302-004e12eb9201]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:49 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092
Sep 11 06:23:49 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:50 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092" returned: 0 in 0.558s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:50 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092
Sep 11 06:23:50 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:50 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-768763f5-4e16-4e1a-8857-f0cd60d2c092" returned: 0 in 0.351s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-quobyte-768763f5-4e16-4e1a-8857-f0cd60d2c092" released by "delete_volume" :: held 0.979s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Created reservations ['be617b97-78f2-432f-8c17-be26c00657ee', 'bf13145f-e36f-44d9-ad46-4174e7cc631a', 'd43a0ada-4dbe-4635-92a9-2b4a60a42c16', '6781cd3e-598d-469e-a076-044b26939cfe'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:50 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:50 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:51 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.279s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:51 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Deleted volume successfully.
Sep 11 06:23:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-731963de-72ee-4a52-b00e-1a15de14dae0 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-768763f5-4e16-4e1a-8857-f0cd60d2c092-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Flow 'volume_create_manager' (32855578-b7fc-4ccc-af7a-96d316e0b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b86912-5484-4eee-a186-34d34be02f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b86912-5484-4eee-a186-34d34be02f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864724326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f84978-1d56-4260-9b13-394c8d6237f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdadc2f05cad4cb09bcc4dd60f266e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:53Z,use_quota=True,user_id='97cce9a382e94588a0c10f981291139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafbddff-28ce-482f-b6c0-d1366d9f3d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafbddff-28ce-482f-b6c0-d1366d9f3d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017e882a-7448-4966-9aca-dfce1a06a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017e882a-7448-4966-9aca-dfce1a06a074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f84978-1d56-4260-9b13-394c8d6237f0', 'volume_name': 'volume-05f84978-1d56-4260-9b13-394c8d6237f0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caef84bc-553b-4612-bea8-23bce1720834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caef84bc-553b-4612-bea8-23bce1720834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617231db-4a5e-4c1b-973d-b100a82da9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Volume 05f84978-1d56-4260-9b13-394c8d6237f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f84978-1d56-4260-9b13-394c8d6237f0', 'volume_size': 1}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864724326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f84978-1d56-4260-9b13-394c8d6237f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdadc2f05cad4cb09bcc4dd60f266e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:23:53Z,use_quota=True,user_id='97cce9a382e94588a0c10f981291139e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Creating volume 05f84978-1d56-4260-9b13-394c8d6237f0 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:23:52 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:23:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:52 devstack sudo[98444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0 1073741824
Sep 11 06:23:52 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:53 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0 1073741824" returned: 0 in 0.550s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:53 devstack sudo[98450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0
Sep 11 06:23:53 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:53 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0" returned: 0 in 0.313s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617231db-4a5e-4c1b-973d-b100a82da9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f84978-1d56-4260-9b13-394c8d6237f0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1430f8-f4ab-4062-9fa7-0761a5b5143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:23:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Volume volume-05f84978-1d56-4260-9b13-394c8d6237f0 (05f84978-1d56-4260-9b13-394c8d6237f0): created successfully
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1430f8-f4ab-4062-9fa7-0761a5b5143f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:23:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Flow 'volume_create_manager' (32855578-b7fc-4ccc-af7a-96d316e0b399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:23:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b9a8e738-d042-45ed-926b-1b89de333d6f tempest-VolumesTransfersV355Test-1334326225 None] Created volume successfully.
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Acquiring lock "cinder-05f84978-1d56-4260-9b13-394c8d6237f0-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-05f84978-1d56-4260-9b13-394c8d6237f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Acquiring lock "cinder-quobyte-05f84978-1d56-4260-9b13-394c8d6237f0" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-quobyte-05f84978-1d56-4260-9b13-394c8d6237f0" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cbb7e0-e293-4d90-b041-ac82b4e9a8c0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:55 devstack sudo[98454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0
Sep 11 06:23:55 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:55 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0" returned: 0 in 0.439s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:55 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0
Sep 11 06:23:55 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:55 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-05f84978-1d56-4260-9b13-394c8d6237f0" returned: 0 in 0.300s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-quobyte-05f84978-1d56-4260-9b13-394c8d6237f0" released by "delete_volume" :: held 0.798s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:23:55 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Created reservations ['03187dcb-a878-44cb-9eef-f63ea35487fe', '8266de49-12a3-4880-b769-302dc122a04b', 'ca3954e5-dde2-4d9f-9723-55593ddb7aa4', '7fff2bdb-4cde-46ba-b9b8-157b0ecbafcb'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:23:56 devstack sudo[98463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:23:56 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:23:56 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.342s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:23:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Deleted volume successfully.
Sep 11 06:23:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a2bc6c23-168a-4d86-ad9d-424121038117 tempest-VolumesTransfersV355Test-1743312122 None] Lock "cinder-05f84978-1d56-4260-9b13-394c8d6237f0-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Flow 'volume_create_manager' (2bafa90e-41df-4faf-a457-23a1837f802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac4e0af-1787-421c-91d7-a8a1a95c4d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac4e0af-1787-421c-91d7-a8a1a95c4d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-54054635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae8cc6e-3a28-4026-8f5c-665b154bcf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e8bae26074417ac4f52d9d1700c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:00Z,use_quota=True,user_id='b15d3946382f4aaaabfbcf1b5aba6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151eebe2-c3ed-4ab0-8049-234e941b5323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151eebe2-c3ed-4ab0-8049-234e941b5323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47925a54-066a-406a-9ad9-88380862d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47925a54-066a-406a-9ad9-88380862d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae8cc6e-3a28-4026-8f5c-665b154bcf41', 'volume_name': 'volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab60deba-0c97-42d1-8003-9ab8fce7a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab60deba-0c97-42d1-8003-9ab8fce7a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81c42b6-3d50-4cee-979b-fcd7d2740b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:00 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Volume bae8cc6e-3a28-4026-8f5c-665b154bcf41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41', 'volume_size': 1}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-54054635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae8cc6e-3a28-4026-8f5c-665b154bcf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e8bae26074417ac4f52d9d1700c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:00Z,use_quota=True,user_id='b15d3946382f4aaaabfbcf1b5aba6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Creating volume bae8cc6e-3a28-4026-8f5c-665b154bcf41 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:00 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:00 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41 1073741824
Sep 11 06:24:00 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:00 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41 1073741824" returned: 0 in 0.576s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:00 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41
Sep 11 06:24:00 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:01 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41" returned: 0 in 0.340s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81c42b6-3d50-4cee-979b-fcd7d2740b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b473ab65-babd-469d-86d0-db106daed359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:01 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Volume volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41 (bae8cc6e-3a28-4026-8f5c-665b154bcf41): created successfully
Sep 11 06:24:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b473ab65-babd-469d-86d0-db106daed359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Flow 'volume_create_manager' (2bafa90e-41df-4faf-a457-23a1837f802b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:01 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-410c6f8f-6a21-46c8-80ad-0b2d09ae99bb tempest-VolumesListAdminTestJSON-1563620196 None] Created volume successfully.
Sep 11 06:24:02 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Flow 'volume_create_manager' (6ee3807d-134d-49a2-9ea4-6ed835238870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc05b656-658f-4da5-ba63-01d9c06b2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc05b656-658f-4da5-ba63-01d9c06b2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1642249251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516173b3-1f54-41b4-b93a-4910d1924955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e8bae26074417ac4f52d9d1700c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:03Z,use_quota=True,user_id='b15d3946382f4aaaabfbcf1b5aba6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6efb6f-73fd-4457-8c22-e1e804429c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6efb6f-73fd-4457-8c22-e1e804429c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cc9fc4-38c3-4bbe-aeaa-e501e539f4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cc9fc4-38c3-4bbe-aeaa-e501e539f4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516173b3-1f54-41b4-b93a-4910d1924955', 'volume_name': 'volume-516173b3-1f54-41b4-b93a-4910d1924955', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56471aad-6bba-4b1b-96cc-ab24308cddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56471aad-6bba-4b1b-96cc-ab24308cddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838225f1-18b6-400f-86c3-ce9b5ea207e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Volume 516173b3-1f54-41b4-b93a-4910d1924955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516173b3-1f54-41b4-b93a-4910d1924955', 'volume_size': 1}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1642249251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516173b3-1f54-41b4-b93a-4910d1924955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e8bae26074417ac4f52d9d1700c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:03Z,use_quota=True,user_id='b15d3946382f4aaaabfbcf1b5aba6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Creating volume 516173b3-1f54-41b4-b93a-4910d1924955 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:03 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:03 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955 1073741824
Sep 11 06:24:03 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:03 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955 1073741824" returned: 0 in 0.618s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:03 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955
Sep 11 06:24:03 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:04 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955" returned: 0 in 0.437s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838225f1-18b6-400f-86c3-ce9b5ea207e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516173b3-1f54-41b4-b93a-4910d1924955', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76059809-32b0-433e-82e7-fa01e026dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Volume volume-516173b3-1f54-41b4-b93a-4910d1924955 (516173b3-1f54-41b4-b93a-4910d1924955): created successfully
Sep 11 06:24:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76059809-32b0-433e-82e7-fa01e026dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Flow 'volume_create_manager' (6ee3807d-134d-49a2-9ea4-6ed835238870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-630677b9-adfb-403a-bbf3-b1cbd0de5533 tempest-VolumesListAdminTestJSON-1563620196 None] Created volume successfully.
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Flow 'volume_create_manager' (378ec02a-3742-4e8a-a60d-4c9e4159379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23432769-8d18-4939-8ef5-064fc8d0d452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23432769-8d18-4939-8ef5-064fc8d0d452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-914214620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0400bf99-97dd-4509-a02f-f5037c0d971d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e8bae26074417ac4f52d9d1700c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:06Z,use_quota=True,user_id='b15d3946382f4aaaabfbcf1b5aba6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71dd4bf-56c6-4ebd-af0c-bb017f2b1408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71dd4bf-56c6-4ebd-af0c-bb017f2b1408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1955eb-f192-4964-8625-d1630e87fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1955eb-f192-4964-8625-d1630e87fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0400bf99-97dd-4509-a02f-f5037c0d971d', 'volume_name': 'volume-0400bf99-97dd-4509-a02f-f5037c0d971d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048edf9c-0c6e-424e-a1bd-94bfde4dfbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048edf9c-0c6e-424e-a1bd-94bfde4dfbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6523f6a-3554-41e3-9fd4-93cc7ba609f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:05 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Volume 0400bf99-97dd-4509-a02f-f5037c0d971d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0400bf99-97dd-4509-a02f-f5037c0d971d', 'volume_size': 1}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-914214620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0400bf99-97dd-4509-a02f-f5037c0d971d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05e8bae26074417ac4f52d9d1700c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:06Z,use_quota=True,user_id='b15d3946382f4aaaabfbcf1b5aba6bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Creating volume 0400bf99-97dd-4509-a02f-f5037c0d971d {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:05 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:05 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d 1073741824
Sep 11 06:24:05 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:06 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d 1073741824" returned: 0 in 0.507s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:06 devstack sudo[98501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d
Sep 11 06:24:06 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:06 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d" returned: 0 in 0.285s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6523f6a-3554-41e3-9fd4-93cc7ba609f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0400bf99-97dd-4509-a02f-f5037c0d971d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abccfa20-0f82-4435-beb8-1e4aa76296f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:06 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Volume volume-0400bf99-97dd-4509-a02f-f5037c0d971d (0400bf99-97dd-4509-a02f-f5037c0d971d): created successfully
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abccfa20-0f82-4435-beb8-1e4aa76296f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Flow 'volume_create_manager' (378ec02a-3742-4e8a-a60d-4c9e4159379f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cef4c75a-fcc0-4190-ab55-067b6647ecd2 tempest-VolumesListAdminTestJSON-1563620196 None] Created volume successfully.
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Flow 'volume_create_manager' (ddc3da3e-b919-4063-908a-991f5ab58a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad8736a-f69b-4c66-9b6f-7ef7762fc7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad8736a-f69b-4c66-9b6f-7ef7762fc7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2121229589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9655b27-3b02-4be1-94f9-2bce54dbc9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aebedbea004c54a2c3fec9c0bd4e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:07Z,use_quota=True,user_id='2266507660704490a5ad8785ff0ec17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41020820-f64e-4188-a40e-ae509de16128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41020820-f64e-4188-a40e-ae509de16128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afcab92-6c75-43f4-98ea-df02b0604862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afcab92-6c75-43f4-98ea-df02b0604862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9655b27-3b02-4be1-94f9-2bce54dbc9a7', 'volume_name': 'volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422a191b-8406-4da4-9772-97b30783640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422a191b-8406-4da4-9772-97b30783640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57e6652-4b34-478f-8df1-69dcba3ecd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:06 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Volume f9655b27-3b02-4be1-94f9-2bce54dbc9a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7', 'volume_size': 1}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2121229589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9655b27-3b02-4be1-94f9-2bce54dbc9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aebedbea004c54a2c3fec9c0bd4e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:07Z,use_quota=True,user_id='2266507660704490a5ad8785ff0ec17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Creating volume f9655b27-3b02-4be1-94f9-2bce54dbc9a7 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:06 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:06 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7 1073741824
Sep 11 06:24:06 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (a91e2243-49c2-4c92-aadb-2f6d38c6589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76db1c5-dda3-4f9d-b877-0ab7f37c1c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76db1c5-dda3-4f9d-b877-0ab7f37c1c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-625469023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60842938-cb2f-4576-bc68-e5b028b0704f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:07Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013df28e-172f-4177-9904-0ae7053108eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013df28e-172f-4177-9904-0ae7053108eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d3787d-ade4-4073-bf06-4cd5991cdd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d3787d-ade4-4073-bf06-4cd5991cdd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60842938-cb2f-4576-bc68-e5b028b0704f', 'volume_name': 'volume-60842938-cb2f-4576-bc68-e5b028b0704f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f28f0d7-fdc3-4132-a30e-9f37181d429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f28f0d7-fdc3-4132-a30e-9f37181d429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808493a-18f4-4634-863f-4954c9d3c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:07 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Volume 60842938-cb2f-4576-bc68-e5b028b0704f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60842938-cb2f-4576-bc68-e5b028b0704f', 'volume_size': 1}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:07 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7 1073741824" returned: 0 in 0.569s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:07 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7
Sep 11 06:24:07 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e824f1b2-6594-4b45-9f9f-fa07b673c7c1 req-e6efee92-e6f3-4627-aaac-947761a0898b tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:07 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7" returned: 0 in 0.254s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-625469023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60842938-cb2f-4576-bc68-e5b028b0704f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:07Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Creating volume 60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:07 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57e6652-4b34-478f-8df1-69dcba3ecd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:07 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f 1073741824
Sep 11 06:24:07 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267365c8-3f61-4bd0-99ea-7cdaf7e8fb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:07 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Volume volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7 (f9655b27-3b02-4be1-94f9-2bce54dbc9a7): created successfully
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267365c8-3f61-4bd0-99ea-7cdaf7e8fb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Flow 'volume_create_manager' (ddc3da3e-b919-4063-908a-991f5ab58a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2d6cbf26-39ad-457f-8699-619778da5a0a tempest-VolumesTransfersV357Test-558789397 None] Created volume successfully.
Sep 11 06:24:08 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f 1073741824" returned: 0 in 0.455s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:08 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f
Sep 11 06:24:08 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:08 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Flow 'volume_create_manager' (0eed7487-9283-4ff7-bf5c-c43d4198fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69786b2b-6321-493f-9a24-ef79b532fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f" returned: 0 in 0.334s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e824f1b2-6594-4b45-9f9f-fa07b673c7c1 req-e6efee92-e6f3-4627-aaac-947761a0898b tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.951s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69786b2b-6321-493f-9a24-ef79b532fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28887041-4891-46de-a4d9-7ca37e8c7a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a6c542252e4711909300af00c2a468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:09Z,use_quota=True,user_id='09be8f41c16847d0906467c0fca10ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ed9b65-a25f-4f58-9ea0-1951ecd898a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ed9b65-a25f-4f58-9ea0-1951ecd898a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de990c50-756f-4e16-89e3-3567d6befffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de990c50-756f-4e16-89e3-3567d6befffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28887041-4891-46de-a4d9-7ca37e8c7a78', 'volume_name': 'volume-28887041-4891-46de-a4d9-7ca37e8c7a78', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b8660c-8a59-478f-aceb-34a8cef1526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b8660c-8a59-478f-aceb-34a8cef1526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4381ee32-392f-4fc6-9496-f8abe4e55605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Volume 28887041-4891-46de-a4d9-7ca37e8c7a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28887041-4891-46de-a4d9-7ca37e8c7a78', 'volume_size': 1}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808493a-18f4-4634-863f-4954c9d3c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60842938-cb2f-4576-bc68-e5b028b0704f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6b0f70-b547-4c7e-90b4-d695270bd1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e824f1b2-6594-4b45-9f9f-fa07b673c7c1 req-e6efee92-e6f3-4627-aaac-947761a0898b tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28887041-4891-46de-a4d9-7ca37e8c7a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a6c542252e4711909300af00c2a468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:09Z,use_quota=True,user_id='09be8f41c16847d0906467c0fca10ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Creating volume 28887041-4891-46de-a4d9-7ca37e8c7a78 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:08 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Volume volume-60842938-cb2f-4576-bc68-e5b028b0704f (60842938-cb2f-4576-bc68-e5b028b0704f): created successfully
Sep 11 06:24:08 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78 1073741824
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6b0f70-b547-4c7e-90b4-d695270bd1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:08 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (a91e2243-49c2-4c92-aadb-2f6d38c6589a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8b2867d6-9147-455c-b531-329b60d6db46 tempest-VolumesSnapshotTestJSON-132899384 None] Created volume successfully.
Sep 11 06:24:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-e824f1b2-6594-4b45-9f9f-fa07b673c7c1 req-e6efee92-e6f3-4627-aaac-947761a0898b tempest-TestInstancesWithCinderVolumes-1683070635 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-461ca086-fd48-4789-8db6-6697ccb69666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10066050-b3e4-4c3a-8fa2-ac533fad6fbc', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:24:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-e824f1b2-6594-4b45-9f9f-fa07b673c7c1 req-e6efee92-e6f3-4627-aaac-947761a0898b tempest-TestInstancesWithCinderVolumes-1683070635 None] attachment_update completed successfully.
Sep 11 06:24:09 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78 1073741824" returned: 0 in 0.525s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:09 devstack sudo[98543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78
Sep 11 06:24:09 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:09 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4381ee32-392f-4fc6-9496-f8abe4e55605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28887041-4891-46de-a4d9-7ca37e8c7a78', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071251c2-eeb3-4fc4-97e9-d231c0ec2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:09 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Volume volume-28887041-4891-46de-a4d9-7ca37e8c7a78 (28887041-4891-46de-a4d9-7ca37e8c7a78): created successfully
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071251c2-eeb3-4fc4-97e9-d231c0ec2368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Flow 'volume_create_manager' (0eed7487-9283-4ff7-bf5c-c43d4198fa97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:09 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ab956cbb-0eb8-4481-a3eb-6aa27a851381 tempest-VolumesTransfersV357Test-1724937407 None] Transfer volume completed successfully.
Sep 11 06:24:09 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-84041acc-4947-47d6-8a41-57e1e299a48f tempest-VolumesListAdminTestJSON-1577301784 None] Created volume successfully.
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Creating offline snapshot e34e284d-4132-4f12-ade8-e73a8d1e8d32 of volume 60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffa39b3-5fce-4a84-9930-a4ca37021a10]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:10 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f
Sep 11 06:24:10 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Acquiring lock "cinder-f9655b27-3b02-4be1-94f9-2bce54dbc9a7-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-f9655b27-3b02-4be1-94f9-2bce54dbc9a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Acquiring lock "cinder-quobyte-f9655b27-3b02-4be1-94f9-2bce54dbc9a7" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-quobyte-f9655b27-3b02-4be1-94f9-2bce54dbc9a7" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a3c1d-1905-47bd-bfdd-822b7bf62be6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:10 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f" returned: 0 in 0.414s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:10 devstack sudo[98561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 1G
Sep 11 06:24:10 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:10 devstack sudo[98557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7
Sep 11 06:24:10 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:10 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7" returned: 0 in 0.438s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:10 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Acquiring lock "cinder-28887041-4891-46de-a4d9-7ca37e8c7a78-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:10 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Lock "cinder-28887041-4891-46de-a4d9-7ca37e8c7a78-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:11 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 1G" returned: 0 in 0.595s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60842938-cb2f-4576-bc68-e5b028b0704f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Acquiring lock "cinder-quobyte-28887041-4891-46de-a4d9-7ca37e8c7a78" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "cinder-0400bf99-97dd-4509-a02f-f5037c0d971d-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:11 devstack sudo[98573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60842938-cb2f-4576-bc68-e5b028b0704f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32
Sep 11 06:24:11 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Lock "cinder-quobyte-28887041-4891-46de-a4d9-7ca37e8c7a78" acquired by "delete_volume" :: waited 0.051s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-0400bf99-97dd-4509-a02f-f5037c0d971d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea834c5-2beb-4579-81dc-4315f84935ef]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f9655b27-3b02-4be1-94f9-2bce54dbc9a7" returned: 0 in 0.383s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-quobyte-f9655b27-3b02-4be1-94f9-2bce54dbc9a7" released by "delete_volume" :: held 0.879s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "cinder-quobyte-0400bf99-97dd-4509-a02f-f5037c0d971d" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-quobyte-0400bf99-97dd-4509-a02f-f5037c0d971d" acquired by "delete_volume" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d1fb27-21b5-4025-85af-fb098c94869b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78
Sep 11 06:24:11 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Created reservations ['efc30bef-6e69-4289-b0d0-75f80da8c428', '0986c663-829b-4015-aefa-2ef300915c3b', '61c7f09f-4269-4011-b5f1-721bc4f54f08', '850fb92b-cc95-4e31-ad21-d9f3e9d7cdd3'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:11 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60842938-cb2f-4576-bc68-e5b028b0704f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32" returned: 0 in 0.377s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 is being set with open permissions: ugo+rw
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-013d3c10-322e-4cbc-8c89-32bfc4f0e858 req-6eebb5bd-f439-4869-b528-d52e96bef66c tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:11 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32
Sep 11 06:24:11 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack sudo[98588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d
Sep 11 06:24:11 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:11 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78" returned: 0 in 0.463s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack sudo[98598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78
Sep 11 06:24:11 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32" returned: 0 in 0.286s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack sudo[98605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.info
Sep 11 06:24:11 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d" returned: 0 in 0.453s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:11 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d
Sep 11 06:24:11 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:11 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.307s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Deleted volume successfully.
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-45d5e8b9-0b25-41d3-a383-c1c61748285b tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-f9655b27-3b02-4be1-94f9-2bce54dbc9a7-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:11 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-28887041-4891-46de-a4d9-7ca37e8c7a78" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Lock "cinder-quobyte-28887041-4891-46de-a4d9-7ca37e8c7a78" released by "delete_volume" :: held 0.809s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Created reservations ['6bb01567-0077-4a5a-9590-6bb8109ffaa8', 'd2a3086e-a238-4ad2-9c1c-bea075e29661', '5d22698f-ceb2-4742-bd8a-c38de55e7b1d', '46c125da-a6df-4500-b5fa-b099fac6b17d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:12 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.info" returned: 0 in 0.300s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:12 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.info is being set with open permissions: ugo+rw
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:12 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.info
Sep 11 06:24:12 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:12 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0400bf99-97dd-4509-a02f-f5037c0d971d" returned: 0 in 0.332s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:12 devstack sudo[98615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:12 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-quobyte-0400bf99-97dd-4509-a02f-f5037c0d971d" released by "delete_volume" :: held 0.848s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Created reservations ['a743f7d0-cda0-4868-90c2-396c5773e489', '4fe1ec6b-ea8c-4390-8555-bedf05acb2a2', 'e9e80133-55f1-4fa6-af76-235caf56e7ea', '9ad614ba-ad83-45ed-a6ea-bf9425d7ae03'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:12 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:12 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:12 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.info" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-013d3c10-322e-4cbc-8c89-32bfc4f0e858 req-6eebb5bd-f439-4869-b528-d52e96bef66c tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.933s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "cinder-516173b3-1f54-41b4-b93a-4910d1924955-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:12 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.318s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-013d3c10-322e-4cbc-8c89-32bfc4f0e858 req-6eebb5bd-f439-4869-b528-d52e96bef66c tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Deleted volume successfully.
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-516173b3-1f54-41b4-b93a-4910d1924955-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c76a539d-e186-4a13-9c5a-4c263657b1a9 tempest-VolumesListAdminTestJSON-1577301784 None] Lock "cinder-28887041-4891-46de-a4d9-7ca37e8c7a78-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-342df761-47cd-49aa-9a6c-3592566c135b tempest-VolumesSnapshotTestJSON-132899384 None] Create snapshot completed successfully
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-013d3c10-322e-4cbc-8c89-32bfc4f0e858 req-6eebb5bd-f439-4869-b528-d52e96bef66c tempest-TestInstancesWithCinderVolumes-1683070635 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-68cdea24-9a80-4594-8f00-411d18d0a183', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2339f405-0182-4bb7-a924-ebdd7bb8e9de', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:24:12 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "cinder-quobyte-516173b3-1f54-41b4-b93a-4910d1924955" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Deleted volume successfully.
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-quobyte-516173b3-1f54-41b4-b93a-4910d1924955" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548e9569-b741-4e96-a2aa-9ce93993550b tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-0400bf99-97dd-4509-a02f-f5037c0d971d-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe32f9-26e8-4e1e-be73-a7aa853c15f2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-013d3c10-322e-4cbc-8c89-32bfc4f0e858 req-6eebb5bd-f439-4869-b528-d52e96bef66c tempest-TestInstancesWithCinderVolumes-1683070635 None] attachment_update completed successfully.
Sep 11 06:24:12 devstack sudo[98623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955
Sep 11 06:24:12 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:13 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955" returned: 0 in 0.462s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:13 devstack sudo[98630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955
Sep 11 06:24:13 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Flow 'volume_create_manager' (f76d44e6-9523-4479-95b5-0061fbb8b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ba2698-b209-4d4d-9189-aa06436b754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ba2698-b209-4d4d-9189-aa06436b754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1454363313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6a95c-76b4-4896-ae9b-26af2fad541c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aebedbea004c54a2c3fec9c0bd4e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:13Z,use_quota=True,user_id='2266507660704490a5ad8785ff0ec17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd840ba1-a46f-4faa-86d5-3f99a88e8d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd840ba1-a46f-4faa-86d5-3f99a88e8d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3952cefa-ee95-4724-9737-9848c889fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3952cefa-ee95-4724-9737-9848c889fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c6a95c-76b4-4896-ae9b-26af2fad541c', 'volume_name': 'volume-00c6a95c-76b4-4896-ae9b-26af2fad541c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caa32fa-8f27-4fd0-9a49-a184f5d92d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caa32fa-8f27-4fd0-9a49-a184f5d92d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82af4b5-5d35-4d22-a692-5ac28252febd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Volume 00c6a95c-76b4-4896-ae9b-26af2fad541c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c6a95c-76b4-4896-ae9b-26af2fad541c', 'volume_size': 1}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1454363313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6a95c-76b4-4896-ae9b-26af2fad541c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2aebedbea004c54a2c3fec9c0bd4e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:13Z,use_quota=True,user_id='2266507660704490a5ad8785ff0ec17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Creating volume 00c6a95c-76b4-4896-ae9b-26af2fad541c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:13 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:13 devstack sudo[98633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c 1073741824
Sep 11 06:24:13 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:13 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-e34e284d-4132-4f12-ade8-e73a8d1e8d32-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-516173b3-1f54-41b4-b93a-4910d1924955" returned: 0 in 0.355s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-quobyte-516173b3-1f54-41b4-b93a-4910d1924955" released by "delete_volume" :: held 0.896s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-e34e284d-4132-4f12-ade8-e73a8d1e8d32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-60842938-cb2f-4576-bc68-e5b028b0704f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Created reservations ['9023ceeb-72fd-4c09-a905-53841a5e112e', '5a5179af-dcd6-492e-a9c0-e1a2c4c89052', '9b708c02-49a8-4ad7-9bbf-0ab26aaef9ef', 'efa95d3f-3ec8-4705-bced-3e05c2b20ada'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-60842938-cb2f-4576-bc68-e5b028b0704f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-e34e284d-4132-4f12-ade8-e73a8d1e8d32" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-e34e284d-4132-4f12-ade8-e73a8d1e8d32" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Deleting offline snapshot e34e284d-4132-4f12-ade8-e73a8d1e8d32 of volume 60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] snapshot_file for this snap is: volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b22418-c65e-4b56-8607-49cc2a1e02d5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:13 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:13 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:13 devstack sudo[98635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32
Sep 11 06:24:13 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:13 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c 1073741824" returned: 0 in 0.518s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:14 devstack sudo[98643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c
Sep 11 06:24:14 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:14 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.286s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Deleted volume successfully.
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9652915-6b4b-4be2-a715-24f60712903c tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-516173b3-1f54-41b4-b93a-4910d1924955-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:14 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32" returned: 0 in 0.412s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60842938-cb2f-4576-bc68-e5b028b0704f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f891b20-28e2-43c4-88d4-12c553e82f72]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:14 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c" returned: 0 in 0.259s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82af4b5-5d35-4d22-a692-5ac28252febd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c6a95c-76b4-4896-ae9b-26af2fad541c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b94342-4a93-4f5b-a132-e61bb5bbeec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:14 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f
Sep 11 06:24:14 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:14 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Volume volume-00c6a95c-76b4-4896-ae9b-26af2fad541c (00c6a95c-76b4-4896-ae9b-26af2fad541c): created successfully
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b94342-4a93-4f5b-a132-e61bb5bbeec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Flow 'volume_create_manager' (f76d44e6-9523-4479-95b5-0061fbb8b229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-89e7ebba-cf2e-403f-b324-98ae4187e915 tempest-VolumesTransfersV357Test-558789397 None] Created volume successfully.
Sep 11 06:24:14 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:14 devstack sudo[98660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32
Sep 11 06:24:14 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "cinder-bae8cc6e-3a28-4026-8f5c-665b154bcf41-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-bae8cc6e-3a28-4026-8f5c-665b154bcf41-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "cinder-quobyte-bae8cc6e-3a28-4026-8f5c-665b154bcf41" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-quobyte-bae8cc6e-3a28-4026-8f5c-665b154bcf41" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[65394e3a-487a-4ed8-bb92-d30c499dceea]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:14 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32" returned: 0 in 0.416s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:14 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41
Sep 11 06:24:14 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:14 devstack sudo[98671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32
Sep 11 06:24:14 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:15 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f.e34e284d-4132-4f12-ade8-e73a8d1e8d32" returned: 0 in 0.304s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:15 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41" returned: 0 in 0.476s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-e34e284d-4132-4f12-ade8-e73a8d1e8d32" released by "_delete_snapshot" :: held 1.651s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-60842938-cb2f-4576-bc68-e5b028b0704f" released by "delete_snapshot" :: held 1.690s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:15 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41
Sep 11 06:24:15 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['a5d59f83-7e4d-4585-be5f-e99b7379614d', '50022e02-b2cd-45e5-8b8f-076096069578', '43360cbf-a9df-468d-8d67-6398b2eb89c5', '5c2f0912-3c7a-4a1c-9537-74c533e79a88'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:15 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Delete snapshot completed successfully.
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a075cc79-30ec-4d33-9ff8-e7bb76ac06a1 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-e34e284d-4132-4f12-ade8-e73a8d1e8d32-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:15 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bae8cc6e-3a28-4026-8f5c-665b154bcf41" returned: 0 in 0.369s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-quobyte-bae8cc6e-3a28-4026-8f5c-665b154bcf41" released by "delete_volume" :: held 0.902s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Acquiring lock "cinder-00c6a95c-76b4-4896-ae9b-26af2fad541c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-00c6a95c-76b4-4896-ae9b-26af2fad541c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Created reservations ['50276f34-9133-41a2-9bf9-8b1d3403b196', '797d37de-4957-4d09-90d1-75c08265b191', '2b9f1899-94a8-4a94-a0d1-71b949db4dd9', 'e5e7d1f3-b506-4d89-82ce-0030806384a0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Acquiring lock "cinder-quobyte-00c6a95c-76b4-4896-ae9b-26af2fad541c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-quobyte-00c6a95c-76b4-4896-ae9b-26af2fad541c" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aca13f-f803-46d0-bc8d-0ee93204c8a9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:15 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:15 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:16 devstack sudo[98681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c
Sep 11 06:24:16 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:16 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.305s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Deleted volume successfully.
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b557568f-30ba-4d06-87af-2e13ae606f4f tempest-VolumesListAdminTestJSON-1563620196 None] Lock "cinder-bae8cc6e-3a28-4026-8f5c-665b154bcf41-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:16 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c" returned: 0 in 0.467s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:16 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c
Sep 11 06:24:16 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (e254e6c8-5b0a-456a-940e-319a786dec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f30d56c-0080-4f27-b475-39e744d13afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f30d56c-0080-4f27-b475-39e744d13afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916098134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b120b19-c685-4d33-902d-1ed83d4d979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:16Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2886dcf-1429-4377-86b3-336f5bd06c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2886dcf-1429-4377-86b3-336f5bd06c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d741c4e-d1d8-4545-af0f-55f76c662f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d741c4e-d1d8-4545-af0f-55f76c662f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b120b19-c685-4d33-902d-1ed83d4d979e', 'volume_name': 'volume-7b120b19-c685-4d33-902d-1ed83d4d979e', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2d232e-dc1e-4a65-928e-6a3e70d37b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2d232e-dc1e-4a65-928e-6a3e70d37b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1931db1-0809-41cd-894f-d04338c0d0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:16 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Volume 7b120b19-c685-4d33-902d-1ed83d4d979e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b120b19-c685-4d33-902d-1ed83d4d979e', 'volume_size': 1}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916098134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b120b19-c685-4d33-902d-1ed83d4d979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:16Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Creating volume 7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:16 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:16 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e 1073741824
Sep 11 06:24:16 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:16 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00c6a95c-76b4-4896-ae9b-26af2fad541c" returned: 0 in 0.247s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-quobyte-00c6a95c-76b4-4896-ae9b-26af2fad541c" released by "delete_volume" :: held 0.778s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Created reservations ['d2a2aba6-a3ac-42d9-865e-02e40fd47fb2', '032755c6-3f4a-4218-8ae0-cc30abcbdbf9', 'fa43161b-de33-4f90-b0e2-7ecb2c8abb47', '0a0720e5-820f-4e08-9532-a5f6e966eddb'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:16 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:16 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:17 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:17 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e 1073741824" returned: 0 in 0.589s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.330s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Deleted volume successfully.
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fa36c92c-2c6b-4f34-83c3-959467fe0e6a tempest-VolumesTransfersV357Test-1411958318 None] Lock "cinder-00c6a95c-76b4-4896-ae9b-26af2fad541c-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:17 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e
Sep 11 06:24:17 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:17 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e" returned: 0 in 0.334s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1931db1-0809-41cd-894f-d04338c0d0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b120b19-c685-4d33-902d-1ed83d4d979e', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693840f2-1383-44e6-bb65-ff23b0e841b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Volume volume-7b120b19-c685-4d33-902d-1ed83d4d979e (7b120b19-c685-4d33-902d-1ed83d4d979e): created successfully
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693840f2-1383-44e6-bb65-ff23b0e841b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (e254e6c8-5b0a-456a-940e-319a786dec77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7b106946-a44f-464b-b4fc-9d5c370dee19 tempest-VolumesSnapshotTestJSON-132899384 None] Created volume successfully.
Sep 11 06:24:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-053e7740-a51c-41a9-b1ce-41a16b1210ed req-75ffff5e-ccf9-4f99-8daa-48252e0fdcdc tempest-TestInstancesWithCinderVolumes-1683070635 None] Terminate volume connection completed successfully.
Sep 11 06:24:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-053e7740-a51c-41a9-b1ce-41a16b1210ed req-75ffff5e-ccf9-4f99-8daa-48252e0fdcdc tempest-TestInstancesWithCinderVolumes-1683070635 None] Deleting attachment 10066050-b3e4-4c3a-8fa2-ac533fad6fbc. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:24:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Creating offline snapshot 46fdb838-5977-4580-9eb3-ac387b944a36 of volume 7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:24:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dcc674-cd28-46ba-b173-3f484da9cc37]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:19 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e
Sep 11 06:24:19 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:19 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e" returned: 0 in 0.465s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:19 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 1G
Sep 11 06:24:19 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "cinder-461ca086-fd48-4789-8db6-6697ccb69666-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-461ca086-fd48-4789-8db6-6697ccb69666-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "cinder-quobyte-461ca086-fd48-4789-8db6-6697ccb69666" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-quobyte-461ca086-fd48-4789-8db6-6697ccb69666" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca3e92-00df-46af-b1ff-71a894d3d092]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:19 devstack sudo[98743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666
Sep 11 06:24:19 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:20 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 1G" returned: 0 in 0.743s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b120b19-c685-4d33-902d-1ed83d4d979e -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:20 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b120b19-c685-4d33-902d-1ed83d4d979e -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36
Sep 11 06:24:20 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:20 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666" returned: 0 in 0.575s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:20 devstack sudo[98751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666
Sep 11 06:24:20 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:20 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b120b19-c685-4d33-902d-1ed83d4d979e -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36" returned: 0 in 0.466s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:20 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 is being set with open permissions: ugo+rw
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:20 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36
Sep 11 06:24:20 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:20 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-461ca086-fd48-4789-8db6-6697ccb69666" returned: 0 in 0.433s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-quobyte-461ca086-fd48-4789-8db6-6697ccb69666" released by "delete_volume" :: held 1.095s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:20 devstack cinder-volume[88109]: WARNING cinder.quota [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586540691-310848851 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586540691-310848851, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:24:20 devstack cinder-volume[88109]: WARNING cinder.quota [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586540691-310848851 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586540691-310848851, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Created reservations ['7947632f-0dc0-4b55-8b9c-2f59b8baa83d', 'c9b804ef-0390-4e5d-b738-1026ee43e062', 'c1ae4ec6-6bbc-47fa-89d6-e6747ecfec43', 'bf25f9da-009c-4dec-8a09-2e279e748066'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:21 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:21 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:21 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36" returned: 0 in 0.497s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:21 devstack sudo[98763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.info
Sep 11 06:24:21 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:21 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.309s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Deleted volume successfully.
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-87c9cb64-40e8-4285-a53b-e3d8ec6de99f tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-461ca086-fd48-4789-8db6-6697ccb69666-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:21 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.info" returned: 0 in 0.428s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:21 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.info is being set with open permissions: ugo+rw
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:21 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.info
Sep 11 06:24:21 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:21 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.info" returned: 0 in 0.304s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-721f2d3d-a4c1-451c-90d7-9bbbd91520d8 tempest-VolumesSnapshotTestJSON-132899384 None] Create snapshot completed successfully
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (b837d8dd-ed3c-47d0-9a34-437f25155aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd9b3f8-3de9-499d-b606-f514a1815141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd9b3f8-3de9-499d-b606-f514a1815141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-276713775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2d7c1e-3f86-4397-9d9e-1a624bb848a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=46fdb838-5977-4580-9eb3-ac387b944a36,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:23Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9174a230-ed9c-4cfb-ace9-0a9e5ae28df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9174a230-ed9c-4cfb-ace9-0a9e5ae28df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5df9cea-8ccf-4694-9922-773d4bc7c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5df9cea-8ccf-4694-9922-773d4bc7c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d2d7c1e-3f86-4397-9d9e-1a624bb848a4', 'volume_name': 'volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4', 'volume_size': 2, 'snapshot_id': '46fdb838-5977-4580-9eb3-ac387b944a36'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a288155-f06e-4c53-b381-c7da38d1b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a288155-f06e-4c53-b381-c7da38d1b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e4a428-1bee-41ee-b333-828e87ef438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:22 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Volume 5d2d7c1e-3f86-4397-9d9e-1a624bb848a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4', 'volume_size': 2, 'snapshot_id': '46fdb838-5977-4580-9eb3-ac387b944a36'}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-46fdb838-5977-4580-9eb3-ac387b944a36-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-46fdb838-5977-4580-9eb3-ac387b944a36-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Creating volume 5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 from snapshot 46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] snapshot: 46fdb838-5977-4580-9eb3-ac387b944a36, volume: 5d2d7c1e-3f86-4397-9d9e-1a624bb848a4,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4fcbe1-e61f-4c01-a84f-a95f87ce4957]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:23 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36
Sep 11 06:24:23 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:23 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36" returned: 0 in 0.530s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b120b19-c685-4d33-902d-1ed83d4d979e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8e937-3400-4e2b-92d8-a8e5cd6aae38]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:23 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e
Sep 11 06:24:23 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:24 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e" returned: 0 in 0.496s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:24:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:24:24 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:24:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:24 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4
Sep 11 06:24:24 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:24 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-4cb76413-f1eb-42a3-bdff-ba3e9ba4c070 req-3a9fa143-66d9-4769-ace1-834145d9a55b tempest-TestInstancesWithCinderVolumes-1683070635 None] Terminate volume connection completed successfully.
Sep 11 06:24:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-4cb76413-f1eb-42a3-bdff-ba3e9ba4c070 req-3a9fa143-66d9-4769-ace1-834145d9a55b tempest-TestInstancesWithCinderVolumes-1683070635 None] Deleting attachment 2339f405-0182-4bb7-a924-ebdd7bb8e9de. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:24:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "cinder-68cdea24-9a80-4594-8f00-411d18d0a183-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-68cdea24-9a80-4594-8f00-411d18d0a183-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "cinder-quobyte-68cdea24-9a80-4594-8f00-411d18d0a183" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-quobyte-68cdea24-9a80-4594-8f00-411d18d0a183" acquired by "delete_volume" :: waited 0.048s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f40b3-621b-49f1-93c9-99e4b9085628]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:25 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183
Sep 11 06:24:25 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:26 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183" returned: 0 in 1.106s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:26 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183
Sep 11 06:24:26 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:27 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-68cdea24-9a80-4594-8f00-411d18d0a183" returned: 0 in 0.851s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-quobyte-68cdea24-9a80-4594-8f00-411d18d0a183" released by "delete_volume" :: held 2.118s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:27 devstack cinder-volume[88109]: WARNING cinder.quota [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186992697-2042384335 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186992697-2042384335, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:24:27 devstack cinder-volume[88109]: WARNING cinder.quota [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186992697-2042384335 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-186992697-2042384335, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Created reservations ['f5e3dd7d-31a0-4c08-b93e-c8b0d114ca68', '73e3d991-0910-4d60-a721-0692e61dd239', '95374c43-6ce2-4165-9cdb-919ff9c163fe', '99ffb254-0f5d-4754-8c4d-c63928bd70a3'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:27 devstack sudo[98862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:27 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Flow 'volume_create_manager' (b792e794-b75f-4ee4-a8aa-d0e8fd62579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b363a70-3c04-407f-80a1-70251fa33490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b363a70-3c04-407f-80a1-70251fa33490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-757825975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f64742-668e-4d38-8e1e-cdd7fc421947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e540bcb5137b4a39ae0a509059d24c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:28Z,use_quota=True,user_id='39f841cfe0734b91891f55d5bd2bb598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8bc5cf-d433-4e71-9806-24218ceeffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8bc5cf-d433-4e71-9806-24218ceeffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe90bed-847e-4fe0-9cec-104377a6b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe90bed-847e-4fe0-9cec-104377a6b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f64742-668e-4d38-8e1e-cdd7fc421947', 'volume_name': 'volume-c2f64742-668e-4d38-8e1e-cdd7fc421947', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a95222f-31f0-4187-953c-df002643bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a95222f-31f0-4187-953c-df002643bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841bc8b2-1aa3-48dc-a09a-d09cd45c3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:28 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Volume c2f64742-668e-4d38-8e1e-cdd7fc421947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f64742-668e-4d38-8e1e-cdd7fc421947', 'volume_size': 1}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:28 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 1.073s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Deleted volume successfully.
Sep 11 06:24:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5b93906a-fc44-4b88-9852-def253efcbe4 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-68cdea24-9a80-4594-8f00-411d18d0a183-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:30 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" returned: 0 in 6.742s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:30 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:24:30 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Converted 1024.00 MB image at 151.84 MB/s
Sep 11 06:24:30 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 is being set with open permissions: ugo+rw
Sep 11 06:24:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:30 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4
Sep 11 06:24:30 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:31 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:31 devstack sudo[98870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:31 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" released by "_copy_volume_from_snapshot" :: held 8.168s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-46fdb838-5977-4580-9eb3-ac387b944a36-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" released by "_create_volume_from_snapshot" :: held 8.264s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.282s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-757825975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f64742-668e-4d38-8e1e-cdd7fc421947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e540bcb5137b4a39ae0a509059d24c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:28Z,use_quota=True,user_id='39f841cfe0734b91891f55d5bd2bb598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Creating volume c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:31 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e4a428-1bee-41ee-b333-828e87ef438b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4', 'volume_size': 2, 'snapshot_id': '46fdb838-5977-4580-9eb3-ac387b944a36'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:31 devstack sudo[98872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 1073741824
Sep 11 06:24:31 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed25870-e8ad-4031-92a1-3b0e4f3eeada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:31 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Volume volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 (5d2d7c1e-3f86-4397-9d9e-1a624bb848a4): created successfully
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed25870-e8ad-4031-92a1-3b0e4f3eeada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (b837d8dd-ed3c-47d0-9a34-437f25155aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:31 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8376dabb-bf4f-4e3a-b321-2e0cb1197113 tempest-VolumesSnapshotTestJSON-132899384 None] Created volume successfully.
Sep 11 06:24:31 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.310s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:24:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:24:32 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 1073741824" returned: 0 in 0.771s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:32 devstack sudo[98882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947
Sep 11 06:24:32 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Flow 'volume_create_manager' (0aa3d0a0-5bac-4f8b-aff6-31078cd48614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63030368-711d-4347-a283-a9ae81950a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63030368-711d-4347-a283-a9ae81950a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-839124202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b91fc9-a339-4725-84a6-55b58d27fe4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c4d923c43842b0a3471b1b672e5ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:32Z,use_quota=True,user_id='31af442049644eacadc7ca17a26ecc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983725aa-9221-4767-9eab-3ff892de33c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983725aa-9221-4767-9eab-3ff892de33c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64ee2f3-828a-4d7a-8ef6-81b07fedc606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64ee2f3-828a-4d7a-8ef6-81b07fedc606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b91fc9-a339-4725-84a6-55b58d27fe4f', 'volume_name': 'volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bfe0d0-705c-4dfa-869d-904ca34eef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bfe0d0-705c-4dfa-869d-904ca34eef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45f971f-73c9-4693-a106-04410909272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Volume d6b91fc9-a339-4725-84a6-55b58d27fe4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f', 'volume_size': 1}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ce13f-dcc0-4c42-8baf-3a6eb138ea5e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:32 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947" returned: 0 in 0.609s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-839124202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b91fc9-a339-4725-84a6-55b58d27fe4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c4d923c43842b0a3471b1b672e5ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:32Z,use_quota=True,user_id='31af442049644eacadc7ca17a26ecc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Creating volume d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:32 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:32 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f 1073741824
Sep 11 06:24:32 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841bc8b2-1aa3-48dc-a09a-d09cd45c3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f64742-668e-4d38-8e1e-cdd7fc421947', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71813432-9559-4903-a592-241e343e45bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Volume volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 (c2f64742-668e-4d38-8e1e-cdd7fc421947): created successfully
Sep 11 06:24:32 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4
Sep 11 06:24:32 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71813432-9559-4903-a592-241e343e45bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Flow 'volume_create_manager' (b792e794-b75f-4ee4-a8aa-d0e8fd62579c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:32 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5239119f-5baa-4fcd-a327-e4573452ed16 tempest-VolumesCloneTest-301005050 None] Created volume successfully.
Sep 11 06:24:33 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" returned: 0 in 0.620s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:33 devstack sudo[98918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4
Sep 11 06:24:33 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:33 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f 1073741824" returned: 0 in 0.664s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:33 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:33 devstack sudo[98922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f
Sep 11 06:24:33 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4" released by "delete_volume" :: held 1.079s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['400746b8-a0f3-4ffe-b491-b69cb13245e4', 'f329f48f-de5e-4ba9-a80f-821587c409e4', '317624a1-31f8-4fc2-8ae8-9c80a96d0026', '6a997b48-fc87-4ffb-b797-429f02e6fb1f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:33 devstack sudo[98926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:33 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:33 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f" returned: 0 in 0.378s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45f971f-73c9-4693-a106-04410909272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e3035-ea15-475c-953b-6eb94b4afb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:33 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Volume volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f (d6b91fc9-a339-4725-84a6-55b58d27fe4f): created successfully
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e3035-ea15-475c-953b-6eb94b4afb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Flow 'volume_create_manager' (0aa3d0a0-5bac-4f8b-aff6-31078cd48614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:33 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-36eac3b7-0056-44bc-a350-e498ab41b0f0 tempest-SnapshotMetadataTestJSON-1459901537 None] Created volume successfully.
Sep 11 06:24:34 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.343s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Deleted volume successfully.
Sep 11 06:24:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-98320a6e-5b92-49a4-8629-eabc2d51a8d6 req-0d3daf31-b172-4422-bd4c-7e84549c1749 tempest-TestInstancesWithCinderVolumes-1683070635 None] Terminate volume connection completed successfully.
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-98320a6e-5b92-49a4-8629-eabc2d51a8d6 req-0d3daf31-b172-4422-bd4c-7e84549c1749 tempest-TestInstancesWithCinderVolumes-1683070635 None] Deleting attachment c5eae8d6-5a4d-4f59-b0fd-e9ec03770ec5. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aec615ee-f31a-4d23-8f28-4d3d3b0b9b35 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-5d2d7c1e-3f86-4397-9d9e-1a624bb848a4-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Flow 'volume_create_manager' (4c00da81-2059-4b55-9c64-0cd53e640ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a5839-0c7a-4f7c-b05e-0e57f529b9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a5839-0c7a-4f7c-b05e-0e57f529b9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-920519901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412136df-941c-4a4c-b27d-ccbb35defa93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e540bcb5137b4a39ae0a509059d24c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c2f64742-668e-4d38-8e1e-cdd7fc421947,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:34Z,use_quota=True,user_id='39f841cfe0734b91891f55d5bd2bb598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed798d1-36b5-4e7e-946e-d31d5c324596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed798d1-36b5-4e7e-946e-d31d5c324596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d05193-e5d2-479d-bdd7-f05091911ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d05193-e5d2-479d-bdd7-f05091911ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '412136df-941c-4a4c-b27d-ccbb35defa93', 'volume_name': 'volume-412136df-941c-4a4c-b27d-ccbb35defa93', 'volume_size': 2, 'source_volid': 'c2f64742-668e-4d38-8e1e-cdd7fc421947', 'source_volstatus': 'available'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d158800a-edf2-499c-97d1-aab60bf221a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d158800a-edf2-499c-97d1-aab60bf221a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a5917e-bbcd-493d-8e59-224e444b9ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:34 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Volume 412136df-941c-4a4c-b27d-ccbb35defa93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-412136df-941c-4a4c-b27d-ccbb35defa93', 'volume_size': 2, 'source_volid': 'c2f64742-668e-4d38-8e1e-cdd7fc421947', 'source_volstatus': 'available'}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:34 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Cloning volume c2f64742-668e-4d38-8e1e-cdd7fc421947 to volume 412136df-941c-4a4c-b27d-ccbb35defa93
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-46fdb838-5977-4580-9eb3-ac387b944a36-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Creating offline snapshot 339e1aee-e82c-481c-a89b-5c6e2c8b05d5 of volume c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-46fdb838-5977-4580-9eb3-ac387b944a36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-7b120b19-c685-4d33-902d-1ed83d4d979e" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[238efaa4-6c8e-46fc-8a7b-fb9e06f92391]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-7b120b19-c685-4d33-902d-1ed83d4d979e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-46fdb838-5977-4580-9eb3-ac387b944a36" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-46fdb838-5977-4580-9eb3-ac387b944a36" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Deleting offline snapshot 46fdb838-5977-4580-9eb3-ac387b944a36 of volume 7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] snapshot_file for this snap is: volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bd8801-c572-46f4-bd09-7701140ba350]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:34 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947
Sep 11 06:24:34 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:34 devstack sudo[98931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36
Sep 11 06:24:34 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:35 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947" returned: 0 in 0.442s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:35 devstack sudo[98939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 1G
Sep 11 06:24:35 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:35 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36" returned: 0 in 0.463s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b120b19-c685-4d33-902d-1ed83d4d979e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[919d2821-06e6-4b8b-a6fb-fc53fdf29d84]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:35 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e
Sep 11 06:24:35 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:35 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 1G" returned: 0 in 0.453s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:35 devstack sudo[98950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5
Sep 11 06:24:35 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:35 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e" returned: 0 in 0.548s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:35 devstack sudo[98955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36
Sep 11 06:24:35 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:35 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5" returned: 0 in 0.313s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:35 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 is being set with open permissions: ugo+rw
Sep 11 06:24:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:35 devstack sudo[98958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5
Sep 11 06:24:35 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:36 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5" returned: 0 in 0.249s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:36 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36" returned: 0 in 0.351s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:36 devstack sudo[98964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36
Sep 11 06:24:36 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:36 devstack sudo[98965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.info
Sep 11 06:24:36 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "cinder-e3b76313-4ee6-4226-9c76-5580bdc5fd47-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-e3b76313-4ee6-4226-9c76-5580bdc5fd47-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "cinder-quobyte-e3b76313-4ee6-4226-9c76-5580bdc5fd47" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-quobyte-e3b76313-4ee6-4226-9c76-5580bdc5fd47" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7c480a-4462-4d12-9922-f72e430d3b79]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:36 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:36 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.info" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:36 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.info is being set with open permissions: ugo+rw
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e.46fdb838-5977-4580-9eb3-ac387b944a36" returned: 0 in 0.321s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:36 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.info
Sep 11 06:24:36 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-46fdb838-5977-4580-9eb3-ac387b944a36" released by "_delete_snapshot" :: held 1.796s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-7b120b19-c685-4d33-902d-1ed83d4d979e" released by "delete_snapshot" :: held 1.828s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:36 devstack sudo[98970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47
Sep 11 06:24:36 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['b43de773-45b4-4d0f-a585-19f944f63664', 'add5a504-b849-401d-83f1-a892ebe7ec7a', '81967d4e-4526-4ff1-90dd-0313ed232c27', '7881ee4e-addb-4c24-8a58-4b6626185c19'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Delete snapshot completed successfully.
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7bb88c56-75b3-4e6b-8f44-8ad05ecc3094 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-46fdb838-5977-4580-9eb3-ac387b944a36-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:36 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.info" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Acquiring lock "cinder-quobyte-412136df-941c-4a4c-b27d-ccbb35defa93" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-412136df-941c-4a4c-b27d-ccbb35defa93" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] snapshot: 339e1aee-e82c-481c-a89b-5c6e2c8b05d5, volume: 412136df-941c-4a4c-b27d-ccbb35defa93,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8baac9b-4220-45d8-81c4-5601413dd012]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:36 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-7b120b19-c685-4d33-902d-1ed83d4d979e-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47" returned: 0 in 0.430s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-7b120b19-c685-4d33-902d-1ed83d4d979e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:36 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47
Sep 11 06:24:36 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-7b120b19-c685-4d33-902d-1ed83d4d979e" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:36 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5
Sep 11 06:24:36 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-7b120b19-c685-4d33-902d-1ed83d4d979e" acquired by "delete_volume" :: waited 0.014s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd3951d-7351-44c9-bb95-55cfc943b14b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:37 devstack sudo[98982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e
Sep 11 06:24:37 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:37 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e3b76313-4ee6-4226-9c76-5580bdc5fd47" returned: 0 in 0.317s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-quobyte-e3b76313-4ee6-4226-9c76-5580bdc5fd47" released by "delete_volume" :: held 0.799s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:37 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5" returned: 0 in 0.426s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2f64742-668e-4d38-8e1e-cdd7fc421947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2433e2bf-cac5-4ff5-8202-a034bb45bea9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:37 devstack cinder-volume[88109]: WARNING cinder.quota [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1963863223-1713618609 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1963863223-1713618609, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:24:37 devstack cinder-volume[88109]: WARNING cinder.quota [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1963863223-1713618609 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1963863223-1713618609, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Created reservations ['15f69549-da81-4996-8f8c-f4b28a683670', '0c34333e-26e5-4b54-bcc9-d59b31941140', '601fefb1-70e0-4fa4-9ed3-cbe63bf8c6f0', '71defa4a-db9e-426b-8057-4f2a905d220d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:37 devstack sudo[98988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947
Sep 11 06:24:37 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:37 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e" returned: 0 in 0.387s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:37 devstack sudo[98994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:37 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:37 devstack sudo[98996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e
Sep 11 06:24:37 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:37 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947" returned: 0 in 0.401s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:37 devstack sudo[99004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93
Sep 11 06:24:37 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:37 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7b120b19-c685-4d33-902d-1ed83d4d979e" returned: 0 in 0.307s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:37 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.350s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Deleted volume successfully.
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-7b120b19-c685-4d33-902d-1ed83d4d979e" released by "delete_volume" :: held 0.769s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d7419b33-018a-49c7-9cdc-dea5e249a969 tempest-TestInstancesWithCinderVolumes-1683070635 None] Lock "cinder-e3b76313-4ee6-4226-9c76-5580bdc5fd47-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['5a5552c0-bfa1-4ea9-8f30-343728429366', '2d21926e-b981-434d-8c66-67bc045cd714', '0685d4a4-5198-41b2-9abe-563766bff328', '73f49943-bf96-4a72-b212-4fe35ad181e2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:37 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:37 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:38 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.309s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:38 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:38 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Deleted volume successfully.
Sep 11 06:24:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3a647cfd-17af-466f-bb50-75f920fe82bf tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-7b120b19-c685-4d33-902d-1ed83d4d979e-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (a417b812-5bc3-423a-8e5d-d7827f4ceedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f13d5d-8614-429d-aca3-7917dd3d70e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f13d5d-8614-429d-aca3-7917dd3d70e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-422475655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4f8dbc-efe6-4697-99e5-e2d13832428c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:39Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25641fed-193c-4ee5-8acd-a89f3617adb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25641fed-193c-4ee5-8acd-a89f3617adb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7dfa5e-ad77-47b4-957d-9c186af59d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7dfa5e-ad77-47b4-957d-9c186af59d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4f8dbc-efe6-4697-99e5-e2d13832428c', 'volume_name': 'volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b521647-eeb7-400d-a448-c6f011ab03ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b521647-eeb7-400d-a448-c6f011ab03ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7443b8-f3b6-46fe-87ac-ad3ffee5738c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:39 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Volume 4a4f8dbc-efe6-4697-99e5-e2d13832428c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c', 'volume_size': 1}
Sep 11 06:24:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:42 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93" returned: 0 in 5.392s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:42 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:24:42 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Converted 1024.00 MB image at 189.89 MB/s
Sep 11 06:24:42 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93 is being set with open permissions: ugo+rw
Sep 11 06:24:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:42 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93
Sep 11 06:24:42 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:43 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93" returned: 0 in 0.263s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-412136df-941c-4a4c-b27d-ccbb35defa93" released by "_copy_volume_from_snapshot" :: held 6.567s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=147,cinder:UPDATE=190,cinder:INSERT=43,cinder:DELETE=22 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Acquiring lock "cinder-quobyte-339e1aee-e82c-481c-a89b-5c6e2c8b05d5" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-339e1aee-e82c-481c-a89b-5c6e2c8b05d5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Deleting offline snapshot 339e1aee-e82c-481c-a89b-5c6e2c8b05d5 of volume c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] snapshot_file for this snap is: volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d80d6a-6e61-42c8-80aa-94ed54b0fa4f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:43 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5
Sep 11 06:24:43 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:43 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5" returned: 0 in 0.349s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2f64742-668e-4d38-8e1e-cdd7fc421947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6b3f3-b88b-49d1-b603-7435d6dc78ba]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:43 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947
Sep 11 06:24:43 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:44 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947" returned: 0 in 0.567s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:44 devstack sudo[99042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5
Sep 11 06:24:44 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:44 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5" returned: 0 in 0.374s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:44 devstack sudo[99048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5
Sep 11 06:24:44 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:44 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947.339e1aee-e82c-481c-a89b-5c6e2c8b05d5" returned: 0 in 0.282s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-339e1aee-e82c-481c-a89b-5c6e2c8b05d5" released by "_delete_snapshot" :: held 1.679s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:44 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=155,cinder:UPDATE=175,cinder:INSERT=43,cinder:DELETE=9 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.523s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.289s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a5917e-bbcd-493d-8e59-224e444b9ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412136df-941c-4a4c-b27d-ccbb35defa93', 'volume_size': 2, 'source_volid': 'c2f64742-668e-4d38-8e1e-cdd7fc421947', 'source_volstatus': 'available'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c2921f-ed35-4d9d-90ac-4851c6871821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Creating offline snapshot 33084b30-0e58-4f9e-a6b5-4d2ffc068864 of volume d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:24:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Volume volume-412136df-941c-4a4c-b27d-ccbb35defa93 (412136df-941c-4a4c-b27d-ccbb35defa93): created successfully
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c2921f-ed35-4d9d-90ac-4851c6871821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Flow 'volume_create_manager' (4c00da81-2059-4b55-9c64-0cd53e640ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b718488a-ce1b-411d-9c24-119142752116]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a46a8d9d-c26e-4ad6-ba3b-faf6b392f90e tempest-VolumesCloneTest-301005050 None] Created volume successfully.
Sep 11 06:24:45 devstack sudo[99052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f
Sep 11 06:24:45 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:45 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f" returned: 0 in 0.420s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:45 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 1G
Sep 11 06:24:45 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Acquiring lock "cinder-412136df-941c-4a4c-b27d-ccbb35defa93-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Lock "cinder-412136df-941c-4a4c-b27d-ccbb35defa93-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Acquiring lock "cinder-quobyte-412136df-941c-4a4c-b27d-ccbb35defa93" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-412136df-941c-4a4c-b27d-ccbb35defa93" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d242e0-2ade-46af-8478-3e17591ebdd5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:46 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 1G" returned: 0 in 0.522s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:46 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864
Sep 11 06:24:46 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:46 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93
Sep 11 06:24:46 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:46 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:46 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93" returned: 0 in 0.375s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:46 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 is being set with open permissions: ugo+rw
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:46 devstack sudo[99075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93
Sep 11 06:24:46 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:46 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864
Sep 11 06:24:46 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:46 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:46 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-412136df-941c-4a4c-b27d-ccbb35defa93" returned: 0 in 0.295s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-412136df-941c-4a4c-b27d-ccbb35defa93" released by "delete_volume" :: held 0.728s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:46 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.info
Sep 11 06:24:46 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Created reservations ['fba14416-fd37-4cb2-8ad4-8e1b0010b549', '23ade407-ef97-43e3-a9f8-04e313a95a85', '55f8528b-9968-48b7-92d6-6e18d083edc4', '195c37d0-51d9-49dc-8bbe-03947cbd7f31'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:46 devstack sudo[99084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:46 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:46 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.info" returned: 0 in 0.254s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:46 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.info is being set with open permissions: ugo+rw
Sep 11 06:24:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:47 devstack sudo[99087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.info
Sep 11 06:24:47 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:47 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.266s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Deleted volume successfully.
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Acquiring lock "cinder-c2f64742-668e-4d38-8e1e-cdd7fc421947-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-acf86566-ec36-4f87-b276-705c821fc6d7 tempest-VolumesCloneTest-301005050 None] Lock "cinder-412136df-941c-4a4c-b27d-ccbb35defa93-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Lock "cinder-c2f64742-668e-4d38-8e1e-cdd7fc421947-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Acquiring lock "cinder-quobyte-c2f64742-668e-4d38-8e1e-cdd7fc421947" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-c2f64742-668e-4d38-8e1e-cdd7fc421947" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f1e26-c776-4d67-9493-f6102322e9d2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:47 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.info" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.943s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-422475655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4f8dbc-efe6-4697-99e5-e2d13832428c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:39Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Creating volume 4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:47 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:47 devstack sudo[99092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c 1073741824
Sep 11 06:24:47 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1159d8df-fe8d-45c8-b4de-a398cda39ee2 tempest-SnapshotMetadataTestJSON-1459901537 None] Create snapshot completed successfully
Sep 11 06:24:47 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947
Sep 11 06:24:47 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:47 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947" returned: 0 in 0.447s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:47 devstack sudo[99102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947
Sep 11 06:24:47 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:47 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c 1073741824" returned: 0 in 0.539s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:47 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c
Sep 11 06:24:47 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c2f64742-668e-4d38-8e1e-cdd7fc421947" returned: 0 in 0.317s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:48 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Lock "cinder-quobyte-c2f64742-668e-4d38-8e1e-cdd7fc421947" released by "delete_volume" :: held 0.825s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Created reservations ['3efac003-fca3-428d-9bb9-f24d339d0348', '83aeb52c-6eda-4d56-b35c-96ace6c4059e', '20876b17-8196-4d25-af98-582401bca055', 'b1d6d474-3f5f-4dfc-9d41-57000246b56a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:48 devstack sudo[99110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:48 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:48 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c" returned: 0 in 0.466s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7443b8-f3b6-46fe-87ac-ad3ffee5738c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dcf6ded-5f2d-4158-bd70-0b6b281c0929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:48 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Volume volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c (4a4f8dbc-efe6-4697-99e5-e2d13832428c): created successfully
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dcf6ded-5f2d-4158-bd70-0b6b281c0929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (a417b812-5bc3-423a-8e5d-d7827f4ceedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a6cfeda6-3d5b-4366-ad54-daf9539e954f tempest-VolumesSnapshotTestJSON-132899384 None] Created volume successfully.
Sep 11 06:24:48 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.466s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Deleted volume successfully.
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-daf535d3-fd35-49d9-8648-55952748760a tempest-VolumesCloneTest-301005050 None] Lock "cinder-c2f64742-668e-4d38-8e1e-cdd7fc421947-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "cinder-33084b30-0e58-4f9e-a6b5-4d2ffc068864-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-33084b30-0e58-4f9e-a6b5-4d2ffc068864-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "cinder-quobyte-d6b91fc9-a339-4725-84a6-55b58d27fe4f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-quobyte-d6b91fc9-a339-4725-84a6-55b58d27fe4f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "cinder-quobyte-33084b30-0e58-4f9e-a6b5-4d2ffc068864" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-quobyte-33084b30-0e58-4f9e-a6b5-4d2ffc068864" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Deleting offline snapshot 33084b30-0e58-4f9e-a6b5-4d2ffc068864 of volume d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] snapshot_file for this snap is: volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[23de9944-507d-4fac-9b5e-add5afb27cd0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Creating offline snapshot 2b15d41f-a8f1-495b-b5ab-0bb740e81b42 of volume 4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:24:49 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864
Sep 11 06:24:49 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd93a2-e7b4-4d99-8e33-638620424ee0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:49 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c
Sep 11 06:24:49 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:49 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864" returned: 0 in 0.443s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca3a07-aab0-400f-be4f-b5dcfffb5147]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:49 devstack sudo[99121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f
Sep 11 06:24:49 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:49 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c" returned: 0 in 0.471s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:49 devstack sudo[99127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 1G
Sep 11 06:24:49 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:50 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f" returned: 0 in 0.443s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:50 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864
Sep 11 06:24:50 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:50 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 1G" returned: 0 in 0.599s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:50 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42
Sep 11 06:24:50 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:50 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864" returned: 0 in 0.512s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:50 devstack sudo[99145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864
Sep 11 06:24:50 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:50 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42" returned: 0 in 0.410s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:50 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 is being set with open permissions: ugo+rw
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:50 devstack sudo[99151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42
Sep 11 06:24:50 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:50 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f.33084b30-0e58-4f9e-a6b5-4d2ffc068864" returned: 0 in 0.337s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-quobyte-33084b30-0e58-4f9e-a6b5-4d2ffc068864" released by "_delete_snapshot" :: held 1.879s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-quobyte-d6b91fc9-a339-4725-84a6-55b58d27fe4f" released by "delete_snapshot" :: held 1.931s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Created reservations ['dcb838f6-0a1b-4b8b-b7c6-9d0aaf490701', 'd25bd400-770b-4e4d-bd8b-02f4964a24cf', '764212ec-9908-4fb9-83d8-d6212e488558', 'c4a63710-eb1f-49a3-bb05-32dcf09753d0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:51 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42" returned: 0 in 0.325s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Delete snapshot completed successfully.
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-df60c9c2-6ebd-43f2-8ee0-0b2216d160de tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-33084b30-0e58-4f9e-a6b5-4d2ffc068864-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:51 devstack sudo[99155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.info
Sep 11 06:24:51 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "cinder-d6b91fc9-a339-4725-84a6-55b58d27fe4f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-d6b91fc9-a339-4725-84a6-55b58d27fe4f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "cinder-quobyte-d6b91fc9-a339-4725-84a6-55b58d27fe4f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-quobyte-d6b91fc9-a339-4725-84a6-55b58d27fe4f" acquired by "delete_volume" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3a256-8fa3-46a1-b0d6-ba6c7f1616f4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:51 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:51 devstack sudo[99158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f
Sep 11 06:24:51 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.info" returned: 0 in 0.452s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:51 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.info is being set with open permissions: ugo+rw
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:51 devstack sudo[99161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.info
Sep 11 06:24:51 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:51 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f" returned: 0 in 0.442s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:51 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.info" returned: 0 in 0.323s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:51 devstack sudo[99167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f
Sep 11 06:24:51 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.736s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-40fa9e8a-f4df-4ad3-86b5-d41441bbee9c tempest-VolumesSnapshotTestJSON-132899384 None] Create snapshot completed successfully
Sep 11 06:24:52 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d6b91fc9-a339-4725-84a6-55b58d27fe4f" returned: 0 in 0.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-quobyte-d6b91fc9-a339-4725-84a6-55b58d27fe4f" released by "delete_volume" :: held 0.849s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Created reservations ['c4c71c9d-975a-485b-a424-39cd8ccfb16b', '1aedd35d-3938-4069-ae41-d2b82919784b', '5afb1a84-5b44-4f0e-a71e-0907a4092628', '15789300-e453-4a1f-b79e-e60b6a1ec66c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:52 devstack sudo[99170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:24:52 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:52 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.472s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:24:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Deleted volume successfully.
Sep 11 06:24:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-19961db5-00cd-48ce-9820-a17a6954c236 tempest-SnapshotMetadataTestJSON-1459901537 None] Lock "cinder-d6b91fc9-a339-4725-84a6-55b58d27fe4f-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (7bf895c6-7957-4524-b786-3f80ce3eafd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63132e90-3585-453e-a8db-0ad3c6bac51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63132e90-3585-453e-a8db-0ad3c6bac51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-922363842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470eb946-e915-461f-9bd5-7956298925e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888bd50be377498d92e769bae3884216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b15d41f-a8f1-495b-b5ab-0bb740e81b42,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:53Z,use_quota=True,user_id='990f6056b53d4daf99873c782d3a53a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7e568b-c6e1-436a-aae9-633ff4cf9beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7e568b-c6e1-436a-aae9-633ff4cf9beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3851b5d-6043-42d7-bb8b-854ce6b62aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3851b5d-6043-42d7-bb8b-854ce6b62aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '470eb946-e915-461f-9bd5-7956298925e5', 'volume_name': 'volume-470eb946-e915-461f-9bd5-7956298925e5', 'volume_size': 1, 'snapshot_id': '2b15d41f-a8f1-495b-b5ab-0bb740e81b42'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe91bd2-8ae2-44b7-9c0d-dcd656668dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe91bd2-8ae2-44b7-9c0d-dcd656668dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43777eb7-6354-4111-b703-cf7cc62b00c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Volume 470eb946-e915-461f-9bd5-7956298925e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-470eb946-e915-461f-9bd5-7956298925e5', 'volume_size': 1, 'snapshot_id': '2b15d41f-a8f1-495b-b5ab-0bb740e81b42'}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-2b15d41f-a8f1-495b-b5ab-0bb740e81b42-470eb946-e915-461f-9bd5-7956298925e5" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-2b15d41f-a8f1-495b-b5ab-0bb740e81b42-470eb946-e915-461f-9bd5-7956298925e5" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Creating volume 470eb946-e915-461f-9bd5-7956298925e5 from snapshot 2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-470eb946-e915-461f-9bd5-7956298925e5" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-470eb946-e915-461f-9bd5-7956298925e5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] snapshot: 2b15d41f-a8f1-495b-b5ab-0bb740e81b42, volume: 470eb946-e915-461f-9bd5-7956298925e5,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8333c11e-b1e0-4df5-8e76-26caa49cde49]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:53 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42
Sep 11 06:24:53 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:53 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42" returned: 0 in 0.550s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11d0a1-1f81-4657-b550-b7b6b299f7a0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:54 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c
Sep 11 06:24:54 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:54 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c" returned: 0 in 0.536s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:54 devstack sudo[99183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5
Sep 11 06:24:54 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Flow 'volume_create_manager' (bdc36b0e-399d-493c-9597-1eb71debf0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27bbf68-88f2-4bb3-9abd-e39a8b60fa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27bbf68-88f2-4bb3-9abd-e39a8b60fa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-244538136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380f3b52-203b-4625-a6f6-80b62ec30e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d41ed334b6408db68d6c40dc4d9ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:55Z,use_quota=True,user_id='3b52704625ca4d7ab9ff0b48692fce1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec33d546-7e6f-47ee-8e57-59d1d231fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec33d546-7e6f-47ee-8e57-59d1d231fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3941a51-00bd-4f2f-8a1b-28deebe5e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3941a51-00bd-4f2f-8a1b-28deebe5e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380f3b52-203b-4625-a6f6-80b62ec30e68', 'volume_name': 'volume-380f3b52-203b-4625-a6f6-80b62ec30e68', 'volume_size': 2}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561b0c0c-b247-40b7-bc6d-5a70fa501be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561b0c0c-b247-40b7-bc6d-5a70fa501be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d29e8d-71c6-4970-ae7d-7ff4f3c0e58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:24:54 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Volume 380f3b52-203b-4625-a6f6-80b62ec30e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380f3b52-203b-4625-a6f6-80b62ec30e68', 'volume_size': 2}
Sep 11 06:24:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:24:59 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root
Sep 11 06:24:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5" returned: 0 in 5.392s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:24:59 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:24:59 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Converted 1024.00 MB image at 189.87 MB/s
Sep 11 06:24:59 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5 is being set with open permissions: ugo+rw
Sep 11 06:24:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:24:59 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5
Sep 11 06:24:59 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:00 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-470eb946-e915-461f-9bd5-7956298925e5" released by "_copy_volume_from_snapshot" :: held 6.880s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-2b15d41f-a8f1-495b-b5ab-0bb740e81b42-470eb946-e915-461f-9bd5-7956298925e5" released by "_create_volume_from_snapshot" :: held 6.957s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.977s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.387s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-244538136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380f3b52-203b-4625-a6f6-80b62ec30e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d41ed334b6408db68d6c40dc4d9ed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:24:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:24:55Z,use_quota=True,user_id='3b52704625ca4d7ab9ff0b48692fce1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Creating volume 380f3b52-203b-4625-a6f6-80b62ec30e68 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:00 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68 2147483648 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:00 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68 2147483648
Sep 11 06:25:00 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43777eb7-6354-4111-b703-cf7cc62b00c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470eb946-e915-461f-9bd5-7956298925e5', 'volume_size': 1, 'snapshot_id': '2b15d41f-a8f1-495b-b5ab-0bb740e81b42'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127f7965-ae2d-42fd-a24b-3fa405345bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:00 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Volume volume-470eb946-e915-461f-9bd5-7956298925e5 (470eb946-e915-461f-9bd5-7956298925e5): created successfully
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127f7965-ae2d-42fd-a24b-3fa405345bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Flow 'volume_create_manager' (7bf895c6-7957-4524-b786-3f80ce3eafd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:00 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-99695341-4869-4063-b3c1-8ed078681d56 tempest-VolumesSnapshotTestJSON-132899384 None] Created volume successfully.
Sep 11 06:25:00 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68 2147483648" returned: 0 in 0.512s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:00 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68
Sep 11 06:25:00 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-470eb946-e915-461f-9bd5-7956298925e5-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-470eb946-e915-461f-9bd5-7956298925e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-470eb946-e915-461f-9bd5-7956298925e5" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:01 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68" returned: 0 in 0.337s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-470eb946-e915-461f-9bd5-7956298925e5" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d29e8d-71c6-4970-ae7d-7ff4f3c0e58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380f3b52-203b-4625-a6f6-80b62ec30e68', 'volume_size': 2}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40f5ea6-f1bb-425e-8d9a-68f06c7d5db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[41464db9-6566-4be6-bc1f-6f0936bf5dca]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:01 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Volume volume-380f3b52-203b-4625-a6f6-80b62ec30e68 (380f3b52-203b-4625-a6f6-80b62ec30e68): created successfully
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40f5ea6-f1bb-425e-8d9a-68f06c7d5db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Flow 'volume_create_manager' (bdc36b0e-399d-493c-9597-1eb71debf0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:01 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7da1c9f9-43e6-4fdf-bbd4-2229f01accee tempest-VolumesCloneNegativeTest-1172171902 None] Created volume successfully.
Sep 11 06:25:01 devstack sudo[99209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5
Sep 11 06:25:01 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Acquiring lock "cinder-380f3b52-203b-4625-a6f6-80b62ec30e68-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Lock "cinder-380f3b52-203b-4625-a6f6-80b62ec30e68-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Acquiring lock "cinder-quobyte-380f3b52-203b-4625-a6f6-80b62ec30e68" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:01 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5" returned: 0 in 0.556s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Lock "cinder-quobyte-380f3b52-203b-4625-a6f6-80b62ec30e68" acquired by "delete_volume" :: waited 0.039s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:01 devstack sudo[99230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5
Sep 11 06:25:01 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf119084-aaca-4194-81c2-df946f68be9f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:02 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68
Sep 11 06:25:02 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:02 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-470eb946-e915-461f-9bd5-7956298925e5" returned: 0 in 0.333s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-470eb946-e915-461f-9bd5-7956298925e5" released by "delete_volume" :: held 0.976s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['4d262aff-b27b-4f06-b2bb-fbccb94e8054', 'd0247f42-bee9-42e6-bc58-668f6946b5da', '9bd56677-bff8-4f15-821c-32ba950ba3c5', 'aec95ec5-bcc9-444f-9d07-19a3a130c83d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:02 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68" returned: 0 in 0.455s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:02 devstack sudo[99238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68
Sep 11 06:25:02 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:02 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:02 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:02 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-380f3b52-203b-4625-a6f6-80b62ec30e68" returned: 0 in 0.380s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Lock "cinder-quobyte-380f3b52-203b-4625-a6f6-80b62ec30e68" released by "delete_volume" :: held 0.901s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:02 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.362s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Deleted volume successfully.
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-40f5f341-3fe2-4b66-977e-fccf4577f76f tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-470eb946-e915-461f-9bd5-7956298925e5-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Created reservations ['4e8689e3-b6d3-46a1-b759-af98c50d5b20', 'edf587e4-5187-428f-a575-70d704be5f27', 'e4f92b07-e358-4215-bc68-a12c5fdbb45b', '65de8659-f2cc-46d4-a136-fa11845527c8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:02 devstack sudo[99244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:02 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:03 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.272s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Deleted volume successfully.
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6c458fe2-a234-4241-b178-9cc46fdddaad tempest-VolumesCloneNegativeTest-1172171902 None] Lock "cinder-380f3b52-203b-4625-a6f6-80b62ec30e68-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-2b15d41f-a8f1-495b-b5ab-0bb740e81b42-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-2b15d41f-a8f1-495b-b5ab-0bb740e81b42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-4a4f8dbc-efe6-4697-99e5-e2d13832428c" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-4a4f8dbc-efe6-4697-99e5-e2d13832428c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-2b15d41f-a8f1-495b-b5ab-0bb740e81b42" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-2b15d41f-a8f1-495b-b5ab-0bb740e81b42" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Deleting offline snapshot 2b15d41f-a8f1-495b-b5ab-0bb740e81b42 of volume 4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] snapshot_file for this snap is: volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa3b66b-4ab9-40dd-87b3-14db7f74f7a4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:03 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42
Sep 11 06:25:03 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:04 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42" returned: 0 in 0.540s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8e765f-c28a-45e0-9bb3-bc976f677c8e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:04 devstack sudo[99254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c
Sep 11 06:25:04 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:04 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c" returned: 0 in 0.845s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:04 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42
Sep 11 06:25:04 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:05 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42" returned: 0 in 0.537s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:05 devstack sudo[99265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42
Sep 11 06:25:05 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:05 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c.2b15d41f-a8f1-495b-b5ab-0bb740e81b42" returned: 0 in 0.350s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-2b15d41f-a8f1-495b-b5ab-0bb740e81b42" released by "_delete_snapshot" :: held 2.429s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-4a4f8dbc-efe6-4697-99e5-e2d13832428c" released by "delete_snapshot" :: held 2.460s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:05 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['b9b3d828-807b-417a-9dbc-0dab97b5796d', '7007678c-72cb-4222-9206-d5f544cf15e5', 'b10bc3f2-a89f-49cb-9777-607e0dec895d', 'db6cd5df-dbfd-4d07-a09e-74db527f7537'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Delete snapshot completed successfully.
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-581e1f77-cd1a-4e0f-9623-ea9176ed89af tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-2b15d41f-a8f1-495b-b5ab-0bb740e81b42-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Flow 'volume_create_manager' (e9e69b65-6527-446e-abd1-963d117abb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b065041-2767-4968-836c-2dc0ddaf4615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b065041-2767-4968-836c-2dc0ddaf4615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1075352220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcec5de-30bc-4060-b035-375f47f72062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4994db235ef466b99c6e45e63572cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:06Z,use_quota=True,user_id='66f98b6e3780451593848f63ade610d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d4130a-7b5f-4fb7-b944-a7efcdc654e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d4130a-7b5f-4fb7-b944-a7efcdc654e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c983684c-ad5e-458e-8199-963c3473cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c983684c-ad5e-458e-8199-963c3473cb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbcec5de-30bc-4060-b035-375f47f72062', 'volume_name': 'volume-bbcec5de-30bc-4060-b035-375f47f72062', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03f12c9-0477-4024-a6ea-850128ba6692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03f12c9-0477-4024-a6ea-850128ba6692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bffc817-fdc2-4e72-b816-ec3bc715f95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:06 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Volume bbcec5de-30bc-4060-b035-375f47f72062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbcec5de-30bc-4060-b035-375f47f72062', 'volume_size': 1}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1075352220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcec5de-30bc-4060-b035-375f47f72062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4994db235ef466b99c6e45e63572cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:06Z,use_quota=True,user_id='66f98b6e3780451593848f63ade610d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Creating volume bbcec5de-30bc-4060-b035-375f47f72062 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:06 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:06 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062 1073741824
Sep 11 06:25:06 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-4a4f8dbc-efe6-4697-99e5-e2d13832428c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-4a4f8dbc-efe6-4697-99e5-e2d13832428c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-4a4f8dbc-efe6-4697-99e5-e2d13832428c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-4a4f8dbc-efe6-4697-99e5-e2d13832428c" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd134bb-ee7e-44e7-9acb-8df91f92ab7c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:07 devstack sudo[99274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c
Sep 11 06:25:07 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:07 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062 1073741824" returned: 0 in 0.691s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:07 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062
Sep 11 06:25:07 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:07 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c" returned: 0 in 0.480s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:07 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c
Sep 11 06:25:07 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:07 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062" returned: 0 in 0.471s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bffc817-fdc2-4e72-b816-ec3bc715f95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbcec5de-30bc-4060-b035-375f47f72062', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae425bc-a5c1-4e85-87d2-4aefd0b817e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:07 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Volume volume-bbcec5de-30bc-4060-b035-375f47f72062 (bbcec5de-30bc-4060-b035-375f47f72062): created successfully
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae425bc-a5c1-4e85-87d2-4aefd0b817e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Flow 'volume_create_manager' (e9e69b65-6527-446e-abd1-963d117abb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9884070c-7caa-4f4f-b612-106569369e9d tempest-AbsoluteLimitsTests-905525690 None] Created volume successfully.
Sep 11 06:25:07 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4a4f8dbc-efe6-4697-99e5-e2d13832428c" returned: 0 in 0.380s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-4a4f8dbc-efe6-4697-99e5-e2d13832428c" released by "delete_volume" :: held 0.951s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:07 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['27c8b25d-a8b3-437c-ba9c-4729780e5ce1', '79c394de-60ab-4884-8574-446e69b538df', 'af2c669a-edf3-40a1-b0c5-8fb13039ae8b', '3c8d5305-9bf9-40a7-8e18-c060a6cb9527'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:08 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:08 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:08 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.287s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Deleted volume successfully.
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3e4dc73-ae5c-4b49-82d8-53b749f8fa87 tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-4a4f8dbc-efe6-4697-99e5-e2d13832428c-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Acquiring lock "cinder-bbcec5de-30bc-4060-b035-375f47f72062-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Lock "cinder-bbcec5de-30bc-4060-b035-375f47f72062-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Acquiring lock "cinder-quobyte-bbcec5de-30bc-4060-b035-375f47f72062" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Lock "cinder-quobyte-bbcec5de-30bc-4060-b035-375f47f72062" acquired by "delete_volume" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb98f7-e391-48b6-bd27-38c38b6ca715]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-60842938-cb2f-4576-bc68-e5b028b0704f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-60842938-cb2f-4576-bc68-e5b028b0704f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "cinder-quobyte-60842938-cb2f-4576-bc68-e5b028b0704f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:09 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062
Sep 11 06:25:09 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-60842938-cb2f-4576-bc68-e5b028b0704f" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053f9c8-2232-435e-8ad0-5279de37f04a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:09 devstack sudo[99292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f
Sep 11 06:25:09 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:09 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062" returned: 0 in 0.667s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:09 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062
Sep 11 06:25:09 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:10 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f" returned: 0 in 0.581s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:10 devstack sudo[99303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f
Sep 11 06:25:10 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:10 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bbcec5de-30bc-4060-b035-375f47f72062" returned: 0 in 0.302s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Lock "cinder-quobyte-bbcec5de-30bc-4060-b035-375f47f72062" released by "delete_volume" :: held 1.059s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Created reservations ['06f6558a-d3ce-4c0e-967a-3d021ca2c9f7', '0d4bd4b1-435e-4e3c-9f6b-87b4db116b36', '51f2c1a9-0b9e-4eea-bc02-e0b2da509544', 'aae75009-72ec-4ee2-83e3-68dd71bb5a91'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:10 devstack sudo[99305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:10 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:10 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Flow 'volume_create_manager' (fa90d0b6-1e4b-480e-bb80-a73245b501b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c96c3d-e96b-4f89-9ffa-74a331e57d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-60842938-cb2f-4576-bc68-e5b028b0704f" returned: 0 in 0.471s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c96c3d-e96b-4f89-9ffa-74a331e57d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759909734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398bec6d-4943-4359-9e86-918b0d031a88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0c9bcd16f0b4be0b96cdf2a3acfe7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:10Z,use_quota=True,user_id='27ada9443c9f43f584e0b976af9d987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d534dab-a3b0-4287-b7b8-c5924a9a71bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d534dab-a3b0-4287-b7b8-c5924a9a71bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9051bb3-4a72-4413-9819-e1b983bc3166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9051bb3-4a72-4413-9819-e1b983bc3166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398bec6d-4943-4359-9e86-918b0d031a88', 'volume_name': 'volume-398bec6d-4943-4359-9e86-918b0d031a88', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a8cdfe-c8d7-4f45-bd04-6c4d37e92cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a8cdfe-c8d7-4f45-bd04-6c4d37e92cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e989e8-a312-4e57-b396-7198257e1bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Volume 398bec6d-4943-4359-9e86-918b0d031a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398bec6d-4943-4359-9e86-918b0d031a88', 'volume_size': 1}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759909734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398bec6d-4943-4359-9e86-918b0d031a88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0c9bcd16f0b4be0b96cdf2a3acfe7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:10Z,use_quota=True,user_id='27ada9443c9f43f584e0b976af9d987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Creating volume 398bec6d-4943-4359-9e86-918b0d031a88 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:10 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-quobyte-60842938-cb2f-4576-bc68-e5b028b0704f" released by "delete_volume" :: held 1.214s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:10 devstack sudo[99308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88 1073741824
Sep 11 06:25:10 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:10 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.311s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Deleted volume successfully.
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Created reservations ['d7334ed6-5bce-4c92-95ec-9b8a3f44f74c', '83332d94-4614-4244-8118-424061e4783a', '5cddb3d6-f7e1-474c-8682-ae1339401937', '8d68387a-db72-4cca-9f94-d4156c1388ec'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fe829e1a-3c2d-4043-978e-7e5b9e03c5c7 tempest-AbsoluteLimitsTests-905525690 None] Lock "cinder-bbcec5de-30bc-4060-b035-375f47f72062-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:10 devstack sudo[99311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:10 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:11 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Deleted volume successfully.
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f538b25d-7110-42cb-a5fa-e1639a49d3df tempest-VolumesSnapshotTestJSON-132899384 None] Lock "cinder-60842938-cb2f-4576-bc68-e5b028b0704f-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:11 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88 1073741824" returned: 0 in 0.536s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:11 devstack sudo[99319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88
Sep 11 06:25:11 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:11 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88" returned: 0 in 0.286s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e989e8-a312-4e57-b396-7198257e1bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398bec6d-4943-4359-9e86-918b0d031a88', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0835b119-7c07-4640-aaa8-f748a5969e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:11 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Volume volume-398bec6d-4943-4359-9e86-918b0d031a88 (398bec6d-4943-4359-9e86-918b0d031a88): created successfully
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0835b119-7c07-4640-aaa8-f748a5969e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Flow 'volume_create_manager' (fa90d0b6-1e4b-480e-bb80-a73245b501b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1d940663-e679-4875-873f-39ae4f26c604 tempest-VolumesListTestJSON-964205785 None] Created volume successfully.
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Flow 'volume_create_manager' (c28b244c-c180-4419-b528-2487558f6785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f9eb56-3542-4219-8428-712831b8b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f9eb56-3542-4219-8428-712831b8b528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1254402852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764f4997-2960-4000-bd2d-435aab7cb7ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0c9bcd16f0b4be0b96cdf2a3acfe7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:13Z,use_quota=True,user_id='27ada9443c9f43f584e0b976af9d987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a324ebe-18da-4613-b303-2188a2add4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a324ebe-18da-4613-b303-2188a2add4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c8c0a1-9fb2-4c5f-bbe8-6ced68a732ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c8c0a1-9fb2-4c5f-bbe8-6ced68a732ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764f4997-2960-4000-bd2d-435aab7cb7ce', 'volume_name': 'volume-764f4997-2960-4000-bd2d-435aab7cb7ce', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9c00bb-122c-4c04-8d82-eb14e8702545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9c00bb-122c-4c04-8d82-eb14e8702545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3562865f-f59f-4466-9c09-8554e6e1376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Volume 764f4997-2960-4000-bd2d-435aab7cb7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764f4997-2960-4000-bd2d-435aab7cb7ce', 'volume_size': 1}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1254402852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764f4997-2960-4000-bd2d-435aab7cb7ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0c9bcd16f0b4be0b96cdf2a3acfe7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:13Z,use_quota=True,user_id='27ada9443c9f43f584e0b976af9d987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Creating volume 764f4997-2960-4000-bd2d-435aab7cb7ce {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:13 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:13 devstack sudo[99323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce 1073741824
Sep 11 06:25:13 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:13 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce 1073741824" returned: 0 in 0.461s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:13 devstack sudo[99329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce
Sep 11 06:25:13 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:14 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce" returned: 0 in 0.327s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3562865f-f59f-4466-9c09-8554e6e1376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764f4997-2960-4000-bd2d-435aab7cb7ce', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93556a5-8115-43fb-82fc-0333b5ecf5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:14 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Volume volume-764f4997-2960-4000-bd2d-435aab7cb7ce (764f4997-2960-4000-bd2d-435aab7cb7ce): created successfully
Sep 11 06:25:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93556a5-8115-43fb-82fc-0333b5ecf5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Flow 'volume_create_manager' (c28b244c-c180-4419-b528-2487558f6785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-80976597-b8d3-4de6-aa0c-eda01fa07540 tempest-VolumesListTestJSON-964205785 None] Created volume successfully.
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Flow 'volume_create_manager' (2f3b4c5a-3a9e-4776-b51a-c9a7a58f5e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b23ce5-5959-4494-8745-6d344ef25d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b23ce5-5959-4494-8745-6d344ef25d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-521504146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db490c94-5df7-41b9-8359-61d6953f66fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0c9bcd16f0b4be0b96cdf2a3acfe7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:16Z,use_quota=True,user_id='27ada9443c9f43f584e0b976af9d987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (face3a2a-e753-4ab5-aa91-4874b0bea391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (face3a2a-e753-4ab5-aa91-4874b0bea391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b733c54-bb6b-4214-af5d-82f1a657c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b733c54-bb6b-4214-af5d-82f1a657c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db490c94-5df7-41b9-8359-61d6953f66fb', 'volume_name': 'volume-db490c94-5df7-41b9-8359-61d6953f66fb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d7e242-b8c2-4d61-a530-157b2a3f7f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d7e242-b8c2-4d61-a530-157b2a3f7f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6020d8d2-1077-43d6-a41e-58776771cf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:15 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Volume db490c94-5df7-41b9-8359-61d6953f66fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db490c94-5df7-41b9-8359-61d6953f66fb', 'volume_size': 1}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-521504146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db490c94-5df7-41b9-8359-61d6953f66fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0c9bcd16f0b4be0b96cdf2a3acfe7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:16Z,use_quota=True,user_id='27ada9443c9f43f584e0b976af9d987a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Creating volume db490c94-5df7-41b9-8359-61d6953f66fb {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:15 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:15 devstack sudo[99332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb 1073741824
Sep 11 06:25:15 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:16 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb 1073741824" returned: 0 in 0.524s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:16 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb
Sep 11 06:25:16 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:16 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6020d8d2-1077-43d6-a41e-58776771cf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db490c94-5df7-41b9-8359-61d6953f66fb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7a62ae-bece-486f-82a3-dc3f618a46a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:16 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Volume volume-db490c94-5df7-41b9-8359-61d6953f66fb (db490c94-5df7-41b9-8359-61d6953f66fb): created successfully
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7a62ae-bece-486f-82a3-dc3f618a46a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Flow 'volume_create_manager' (2f3b4c5a-3a9e-4776-b51a-c9a7a58f5e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1dd43fd9-6521-4084-b284-8de351b2a67c tempest-VolumesListTestJSON-964205785 None] Created volume successfully.
Sep 11 06:25:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Acquiring lock "cinder-db490c94-5df7-41b9-8359-61d6953f66fb-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Lock "cinder-db490c94-5df7-41b9-8359-61d6953f66fb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Acquiring lock "cinder-quobyte-db490c94-5df7-41b9-8359-61d6953f66fb" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Lock "cinder-quobyte-db490c94-5df7-41b9-8359-61d6953f66fb" acquired by "delete_volume" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:21 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ecb079-b59c-40d6-aa83-63d1006d47cc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:21 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb
Sep 11 06:25:21 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Flow 'volume_create_manager' (ac1e58d7-ecda-44e8-b68c-5b7c34c118d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f768a8-fbe0-4a0d-9d37-8c0368a42454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f768a8-fbe0-4a0d-9d37-8c0368a42454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1489266216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d54a77-9348-43c6-ac3b-d9d08adaa715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a1c03c20be42aba39a82941f961760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:22Z,use_quota=True,user_id='881a3993aa7a4b1ab65b059ea2f4c971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad745af1-ca4f-4f77-afef-6a7574331848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad745af1-ca4f-4f77-afef-6a7574331848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61e4743-2ace-467d-9b1c-ce0eebb5b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61e4743-2ace-467d-9b1c-ce0eebb5b068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d54a77-9348-43c6-ac3b-d9d08adaa715', 'volume_name': 'volume-80d54a77-9348-43c6-ac3b-d9d08adaa715', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5c380-3197-4820-b28b-e3ee878dc925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a5c380-3197-4820-b28b-e3ee878dc925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f19534-d080-4cc6-90df-8cd9601bcf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:22 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Volume 80d54a77-9348-43c6-ac3b-d9d08adaa715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d54a77-9348-43c6-ac3b-d9d08adaa715', 'volume_size': 1}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1489266216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d54a77-9348-43c6-ac3b-d9d08adaa715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a1c03c20be42aba39a82941f961760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:22Z,use_quota=True,user_id='881a3993aa7a4b1ab65b059ea2f4c971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Creating volume 80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:22 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:22 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 1073741824
Sep 11 06:25:22 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:22 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb" returned: 0 in 0.828s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:22 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb
Sep 11 06:25:22 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:22 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-db490c94-5df7-41b9-8359-61d6953f66fb" returned: 0 in 0.379s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Lock "cinder-quobyte-db490c94-5df7-41b9-8359-61d6953f66fb" released by "delete_volume" :: held 1.293s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Created reservations ['16b18fbd-25ca-47cf-ba1f-c62f27fc4c89', '5978b65d-e6c2-4e25-b0ad-08096ddd4806', 'b13d9f05-8965-4f62-b01d-357ecf1860b8', '25cdcf12-73e6-4e3b-ace7-1bf6930dd51f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:22 devstack sudo[99775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:22 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:22 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 1073741824" returned: 0 in 0.820s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:23 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715
Sep 11 06:25:23 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:23 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.378s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Deleted volume successfully.
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-620ef3c8-73e8-4201-a2d5-9265784f1adb tempest-VolumesListTestJSON-964205785 None] Lock "cinder-db490c94-5df7-41b9-8359-61d6953f66fb-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:23 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715" returned: 0 in 0.323s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f19534-d080-4cc6-90df-8cd9601bcf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d54a77-9348-43c6-ac3b-d9d08adaa715', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b91f78-79d3-4c30-8d16-3ca572e7b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:23 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Volume volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 (80d54a77-9348-43c6-ac3b-d9d08adaa715): created successfully
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b91f78-79d3-4c30-8d16-3ca572e7b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Flow 'volume_create_manager' (ac1e58d7-ecda-44e8-b68c-5b7c34c118d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-449625b5-ef22-49cf-87d6-f34d16f462d0 tempest-VolumesDeleteCascade-337339319 None] Created volume successfully.
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Acquiring lock "cinder-764f4997-2960-4000-bd2d-435aab7cb7ce-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Lock "cinder-764f4997-2960-4000-bd2d-435aab7cb7ce-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Acquiring lock "cinder-quobyte-764f4997-2960-4000-bd2d-435aab7cb7ce" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Lock "cinder-quobyte-764f4997-2960-4000-bd2d-435aab7cb7ce" acquired by "delete_volume" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Flow 'volume_create_manager' (61163635-0715-4efd-b9ec-76725df361aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bac91ec-557a-436c-b8a6-f302f893807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[55463f11-7a44-4b94-9f42-53bf17200353]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bac91ec-557a-436c-b8a6-f302f893807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1893274590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6ca669-a8f3-4d9e-b94e-73a6afacea74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ef62b5ad943198d48f39fb2f5c477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:24Z,use_quota=True,user_id='f0cc4a1cd8ab40dbbff3abfd919b7e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2ae969-9535-497b-b51d-b11d472f11c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2ae969-9535-497b-b51d-b11d472f11c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8878ca65-f4ea-4c24-9492-cacbf05e6b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8878ca65-f4ea-4c24-9492-cacbf05e6b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6ca669-a8f3-4d9e-b94e-73a6afacea74', 'volume_name': 'volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74', 'volume_size': 2}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11088ae6-b1d3-469c-bde8-795baa5db1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11088ae6-b1d3-469c-bde8-795baa5db1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdf225f-a336-4e52-a6c3-e4f9e283d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:23 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Volume bb6ca669-a8f3-4d9e-b94e-73a6afacea74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74', 'volume_size': 2}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1893274590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6ca669-a8f3-4d9e-b94e-73a6afacea74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ef62b5ad943198d48f39fb2f5c477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:24Z,use_quota=True,user_id='f0cc4a1cd8ab40dbbff3abfd919b7e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Creating volume bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:23 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 2147483648 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:23 devstack sudo[99782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 2147483648
Sep 11 06:25:23 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:23 devstack sudo[99781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce
Sep 11 06:25:23 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:24 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce" returned: 0 in 0.491s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:24 devstack sudo[99793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce
Sep 11 06:25:24 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:24 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 2147483648" returned: 0 in 0.618s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:24 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74
Sep 11 06:25:24 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:24 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-764f4997-2960-4000-bd2d-435aab7cb7ce" returned: 0 in 0.327s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Lock "cinder-quobyte-764f4997-2960-4000-bd2d-435aab7cb7ce" released by "delete_volume" :: held 0.905s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Created reservations ['cb082cc3-64a3-4b6e-90be-e72b34e30b40', '9ebecde3-e00a-4c87-8687-74a5cdf3e413', 'd2480151-1b95-4535-aede-2c745f26d51c', '1f567467-3d84-4b92-8802-2ef38d526ca8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:24 devstack sudo[99798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:24 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:24 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" returned: 0 in 0.354s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Creating offline snapshot b58a68a1-5ffb-4562-b99c-368caea32258 of volume 80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdf225f-a336-4e52-a6c3-e4f9e283d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74', 'volume_size': 2}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df9ba98-22c1-4e69-b868-91968441663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[153fc9c9-40c2-4df6-b88d-a1f4799d05d1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:24 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Volume volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 (bb6ca669-a8f3-4d9e-b94e-73a6afacea74): created successfully
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df9ba98-22c1-4e69-b868-91968441663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Flow 'volume_create_manager' (61163635-0715-4efd-b9ec-76725df361aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:24 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2b54c47e-2092-4371-a86d-4148b3fa971e tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Created volume successfully.
Sep 11 06:25:25 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Deleted volume successfully.
Sep 11 06:25:25 devstack sudo[99801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-715722c8-a957-400d-bf9a-50cb6016b39b tempest-VolumesListTestJSON-964205785 None] Lock "cinder-764f4997-2960-4000-bd2d-435aab7cb7ce-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:25 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:25 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715" returned: 0 in 0.443s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:25 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 1G
Sep 11 06:25:25 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:25 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 1G" returned: 0 in 0.497s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:25 devstack sudo[99813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258
Sep 11 06:25:25 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Acquiring lock "cinder-398bec6d-4943-4359-9e86-918b0d031a88-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Lock "cinder-398bec6d-4943-4359-9e86-918b0d031a88-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Acquiring lock "cinder-quobyte-398bec6d-4943-4359-9e86-918b0d031a88" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Lock "cinder-quobyte-398bec6d-4943-4359-9e86-918b0d031a88" acquired by "delete_volume" :: waited 0.035s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[524ec258-c1fb-4be7-85d8-b99f11f7c72a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:26 devstack sudo[99815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88
Sep 11 06:25:26 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:26 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258" returned: 0 in 0.377s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:26 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 is being set with open permissions: ugo+rw
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:26 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258
Sep 11 06:25:26 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:26 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88" returned: 0 in 0.396s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:26 devstack sudo[99826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88
Sep 11 06:25:26 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:26 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258" returned: 0 in 0.283s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:26 devstack sudo[99828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.info
Sep 11 06:25:26 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:26 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-398bec6d-4943-4359-9e86-918b0d031a88" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Lock "cinder-quobyte-398bec6d-4943-4359-9e86-918b0d031a88" released by "delete_volume" :: held 0.733s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Created reservations ['25cb7f5e-0e66-43db-9b4b-b5463eceb362', '8e9f5860-fc9e-42ff-bfe0-62cd5b047d0f', 'f42acea1-4c74-4c59-ba24-996e666d7f60', '175e8de4-e61d-4ebd-867c-8e46ff15245a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:26 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.info" returned: 0 in 0.291s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:26 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.info is being set with open permissions: ugo+rw
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:26 devstack sudo[99832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.info
Sep 11 06:25:26 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:27 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:27 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:27 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.info" returned: 0 in 0.336s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.161s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Creating offline snapshot d963cac1-c4df-4c5e-b63e-a717c15198e8 of volume bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:25:27 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.354s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[00109336-007d-468d-a6b0-80ee081d1ed4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:27 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Deleted volume successfully.
Sep 11 06:25:27 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-79673eaa-2ab9-4f2f-99b3-ec5b8a1d9153 tempest-VolumesDeleteCascade-337339319 None] Create snapshot completed successfully
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44cc21f9-5be7-43da-9e39-46963a860292 tempest-VolumesListTestJSON-964205785 None] Lock "cinder-398bec6d-4943-4359-9e86-918b0d031a88-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:27 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74
Sep 11 06:25:27 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:27 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" returned: 0 in 0.516s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 2G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:27 devstack sudo[99881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 2G
Sep 11 06:25:27 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:28 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 2G" returned: 0 in 0.562s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:28 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8
Sep 11 06:25:28 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:28 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8" returned: 0 in 0.417s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:28 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 is being set with open permissions: ugo+rw
Sep 11 06:25:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:28 devstack sudo[99894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8
Sep 11 06:25:28 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:29 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8" returned: 0 in 0.279s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:29 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.info
Sep 11 06:25:29 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:29 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.info" returned: 0 in 0.349s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:29 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.info is being set with open permissions: ugo+rw
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:29 devstack sudo[99902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.info
Sep 11 06:25:29 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:29 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.info" returned: 0 in 0.329s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.128s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Creating offline snapshot cd4db080-f1e7-4ffe-9580-dce9b60486a8 of volume 80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57bd50b-63ec-42b6-b839-9cedaf5acd04]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:30 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9049ab23-9d04-44a4-a150-c6bd7fad209a tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Create snapshot completed successfully
Sep 11 06:25:30 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258
Sep 11 06:25:30 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "cinder-d963cac1-c4df-4c5e-b63e-a717c15198e8-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-d963cac1-c4df-4c5e-b63e-a717c15198e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "cinder-quobyte-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-quobyte-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "cinder-quobyte-d963cac1-c4df-4c5e-b63e-a717c15198e8" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-quobyte-d963cac1-c4df-4c5e-b63e-a717c15198e8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Deleting offline snapshot d963cac1-c4df-4c5e-b63e-a717c15198e8 of volume bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] snapshot_file for this snap is: volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:25:30 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258" returned: 0 in 0.613s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d54a77-9348-43c6-ac3b-d9d08adaa715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca86ca-c5fb-4d74-99ca-9fc645f3562d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:30 devstack sudo[99926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 1G
Sep 11 06:25:30 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:30 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8
Sep 11 06:25:30 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:31 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:31 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:31 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8" returned: 0 in 0.570s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:31 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 1G" returned: 0 in 0.624s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[376c964c-afe0-4179-9c4c-93c69d176517]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:31 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8
Sep 11 06:25:31 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:31 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74
Sep 11 06:25:31 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:31 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.313s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:25:31 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8" returned: 0 in 0.468s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:31 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 is being set with open permissions: ugo+rw
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:31 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8
Sep 11 06:25:31 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:31 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" returned: 0 in 0.512s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:31 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8
Sep 11 06:25:31 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:32 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8" returned: 0 in 0.303s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:32 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a810b9a3-f41c-47cb-9640-bc91cbd8e5e5 tempest-VolumesDeleteCascade-337339319 None] Create snapshot completed successfully
Sep 11 06:25:32 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8" returned: 0 in 0.513s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:32 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8
Sep 11 06:25:32 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Flow 'volume_create_manager' (08b61148-0fda-4e65-a3be-4152514bcb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd516c4e-d858-48b2-ab97-7549e0055deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:32 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74.d963cac1-c4df-4c5e-b63e-a717c15198e8" returned: 0 in 0.339s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd516c4e-d858-48b2-ab97-7549e0055deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-833057806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3c066d-3761-4c8d-8f36-8ef487231094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5de874d871f4944aeccbbd44926a9b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:33Z,use_quota=True,user_id='01323f19db804dde9654d92bf6e4ee23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1401eade-8a29-48e7-b693-35a8e88de059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1401eade-8a29-48e7-b693-35a8e88de059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03e6542-8cd6-4e30-b1d1-56896b7a1b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03e6542-8cd6-4e30-b1d1-56896b7a1b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3c066d-3761-4c8d-8f36-8ef487231094', 'volume_name': 'volume-2f3c066d-3761-4c8d-8f36-8ef487231094', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3954dde8-c0d7-43e2-b5b7-38c073ca4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3954dde8-c0d7-43e2-b5b7-38c073ca4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b297c6b-c7e4-42f7-8431-e77aca296d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Volume 2f3c066d-3761-4c8d-8f36-8ef487231094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3c066d-3761-4c8d-8f36-8ef487231094', 'volume_size': 1}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-833057806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3c066d-3761-4c8d-8f36-8ef487231094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5de874d871f4944aeccbbd44926a9b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:33Z,use_quota=True,user_id='01323f19db804dde9654d92bf6e4ee23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Creating volume 2f3c066d-3761-4c8d-8f36-8ef487231094 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:32 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:32 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094 1073741824
Sep 11 06:25:32 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-quobyte-d963cac1-c4df-4c5e-b63e-a717c15198e8" released by "_delete_snapshot" :: held 2.242s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-quobyte-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" released by "delete_snapshot" :: held 2.285s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Created reservations ['0992c81d-7e72-433a-8d81-713f68f36a28', 'a5e395a9-7439-49d8-97d0-c8f4c136864b', 'a1d5101c-cd86-425a-90f9-24bc00b8eaec', '148deb89-23b8-4f5d-acfa-1d1b4b8af22f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:32 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Delete snapshot completed successfully.
Sep 11 06:25:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-66e3c5cb-e413-4c09-ad8d-3d3b9f73a3e8 tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-d963cac1-c4df-4c5e-b63e-a717c15198e8-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-80d54a77-9348-43c6-ac3b-d9d08adaa715-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-80d54a77-9348-43c6-ac3b-d9d08adaa715-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Performing cascade delete. {{(pid=88109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-b58a68a1-5ffb-4562-b99c-368caea32258-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-b58a68a1-5ffb-4562-b99c-368caea32258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-b58a68a1-5ffb-4562-b99c-368caea32258" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-b58a68a1-5ffb-4562-b99c-368caea32258" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Deleting offline snapshot b58a68a1-5ffb-4562-b99c-368caea32258 of volume 80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:25:33 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] snapshot_file for this snap is: volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094 1073741824" returned: 0 in 0.593s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c31a318-a640-4a79-bc4c-82d679257b29]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:33 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094
Sep 11 06:25:33 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:33 devstack sudo[99972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258
Sep 11 06:25:33 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:33 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094" returned: 0 in 0.594s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b297c6b-c7e4-42f7-8431-e77aca296d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3c066d-3761-4c8d-8f36-8ef487231094', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d9748b-ec88-453e-88bd-15fdeb9c4eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "cinder-bb6ca669-a8f3-4d9e-b94e-73a6afacea74-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:34 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Volume volume-2f3c066d-3761-4c8d-8f36-8ef487231094 (2f3c066d-3761-4c8d-8f36-8ef487231094): created successfully
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d9748b-ec88-453e-88bd-15fdeb9c4eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Flow 'volume_create_manager' (08b61148-0fda-4e65-a3be-4152514bcb53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-bb6ca669-a8f3-4d9e-b94e-73a6afacea74-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:34 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258" returned: 0 in 0.801s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d54a77-9348-43c6-ac3b-d9d08adaa715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-89140670-7711-4659-bfeb-9bf0ca5d8fc9 tempest-VolumesNegativeTest-338062390 None] Created volume successfully.
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6f941c-8f65-43f5-9f41-12ae7d19bb18]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "cinder-quobyte-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-quobyte-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" acquired by "delete_volume" :: waited 0.058s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61625e0-6159-4161-9121-3ea38f0c6b5c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:34 devstack sudo[100022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715
Sep 11 06:25:34 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:34 devstack sudo[100040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74
Sep 11 06:25:34 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:35 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715" returned: 0 in 0.865s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[720cbf16-481b-47e0-97c2-d48506349c1f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:35 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" returned: 0 in 0.806s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:35 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74
Sep 11 06:25:35 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:35 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8
Sep 11 06:25:35 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:35 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" returned: 0 in 0.572s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-quobyte-bb6ca669-a8f3-4d9e-b94e-73a6afacea74" released by "delete_volume" :: held 1.520s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:35 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8" returned: 0 in 0.776s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d54a77-9348-43c6-ac3b-d9d08adaa715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[753276b3-9d97-4295-8cfe-2390229526fe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Created reservations ['a45ecfb2-8615-4e67-94c1-7b40c0400c0b', 'ab032753-4c46-4cb7-a4c3-f924df56a071', 'd0983abe-4fb2-4e65-b7d7-a06d1959411a', '0d60fae6-1b0f-4c53-8834-18735de3482c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:36 devstack sudo[100073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258
Sep 11 06:25:36 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:36 devstack sudo[100074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:36 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:36 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.360s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Deleted volume successfully.
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d6f1f8a0-e787-4df7-ac38-411c70f5183b tempest-VolumesSnapshotNegativeTestJSON-1663465234 None] Lock "cinder-bb6ca669-a8f3-4d9e-b94e-73a6afacea74-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:36 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258" returned: 0 in 0.782s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d54a77-9348-43c6-ac3b-d9d08adaa715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc29c09-930b-4402-8368-f973a3d3d004]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:37 devstack sudo[100081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715
Sep 11 06:25:37 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:37 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715" returned: 0 in 0.739s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:37 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258
Sep 11 06:25:37 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:38 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258" returned: 0 in 0.704s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:38 devstack sudo[100092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258
Sep 11 06:25:38 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:38 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.b58a68a1-5ffb-4562-b99c-368caea32258" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 -F qcow2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:38 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 -F qcow2
Sep 11 06:25:38 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:39 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 -F qcow2" returned: 0 in 0.572s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-b58a68a1-5ffb-4562-b99c-368caea32258" released by "_delete_snapshot" :: held 5.960s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" released by "delete_snapshot" :: held 5.999s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Created reservations ['a7ed93e5-6aa0-404c-98bc-e4664961ac75', '8b738259-fe63-498a-ab85-8ac743717449', '1048047f-4eaf-41f7-9cb6-25ac29c9ac65', '21be1d06-f156-4133-be7c-3a58756781fb'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Delete snapshot completed successfully.
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-b58a68a1-5ffb-4562-b99c-368caea32258-delete_snapshot" released by "delete_snapshot" :: held 6.298s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-cd4db080-f1e7-4ffe-9580-dce9b60486a8-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-cd4db080-f1e7-4ffe-9580-dce9b60486a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-cd4db080-f1e7-4ffe-9580-dce9b60486a8" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-cd4db080-f1e7-4ffe-9580-dce9b60486a8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Deleting offline snapshot cd4db080-f1e7-4ffe-9580-dce9b60486a8 of volume 80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] snapshot_file for this snap is: volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a7225-d375-4ac9-aea7-5985974d4a29]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:39 devstack sudo[100116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8
Sep 11 06:25:39 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:40 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8" returned: 0 in 0.605s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d54a77-9348-43c6-ac3b-d9d08adaa715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8e39d-7111-4b73-8b85-f426712d7efc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:40 devstack sudo[100123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715
Sep 11 06:25:40 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:41 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715" returned: 0 in 0.665s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:41 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8
Sep 11 06:25:41 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:41 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8" returned: 0 in 0.466s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:41 devstack sudo[100133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8
Sep 11 06:25:41 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:42 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715.cd4db080-f1e7-4ffe-9580-dce9b60486a8" returned: 0 in 0.503s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-cd4db080-f1e7-4ffe-9580-dce9b60486a8" released by "_delete_snapshot" :: held 2.453s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" released by "delete_snapshot" :: held 2.495s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Created reservations ['7c48dde4-ce06-45f0-98f9-ba1c14865516', '1fad157f-3514-4fc2-9b96-4d505d5b2930', '4ed04fd4-4ef8-420a-98c4-07a337a3ff3f', 'fb724188-6f62-423c-97c0-8e53376a21ea'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Delete snapshot completed successfully.
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-cd4db080-f1e7-4ffe-9580-dce9b60486a8-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Snapshots deleted, issuing volume delete {{(pid=88109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e8490-957d-4c82-bdab-8c9e03722690]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:42 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715
Sep 11 06:25:42 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:42 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715" returned: 0 in 0.448s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:42 devstack sudo[100142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715
Sep 11 06:25:42 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:43 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-80d54a77-9348-43c6-ac3b-d9d08adaa715" returned: 0 in 0.384s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-80d54a77-9348-43c6-ac3b-d9d08adaa715" released by "delete_volume" :: held 0.949s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=163,cinder:SELECT=129,cinder:INSERT=40,cinder:DELETE=12 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Created reservations ['20f4255d-6489-4c7c-a83a-5a9955b00fb9', '7ee1493e-8145-45d6-b11c-664812435cb7', 'fc22cdc9-0b2f-4f84-bd1b-93e515ad7ae6', 'c9779f87-41df-4385-8b6d-0b86d3f8ca89'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:43 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:25:43 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:43 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.499s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:43 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:25:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Deleted volume successfully.
Sep 11 06:25:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-34db48f7-bdc7-496c-be32-bbdcdf26f208 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-80d54a77-9348-43c6-ac3b-d9d08adaa715-delete_volume" released by "delete_volume" :: held 10.869s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Flow 'volume_create_manager' (8bfc3c3c-30bb-4461-9be6-f1a5074568b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa741420-0e3d-43d9-91ca-879f3dcd4cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa741420-0e3d-43d9-91ca-879f3dcd4cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1892194171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79616c7a-6e92-49e2-9978-f7921202a924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a1c03c20be42aba39a82941f961760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:46Z,use_quota=True,user_id='881a3993aa7a4b1ab65b059ea2f4c971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24931860-7dbc-4ebc-9225-07007a4a878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24931860-7dbc-4ebc-9225-07007a4a878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860c8398-5839-4837-b1b5-74de7060d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860c8398-5839-4837-b1b5-74de7060d66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79616c7a-6e92-49e2-9978-f7921202a924', 'volume_name': 'volume-79616c7a-6e92-49e2-9978-f7921202a924', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f96af14-f136-4762-ad8c-61dee9104abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f96af14-f136-4762-ad8c-61dee9104abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8001ee7c-4208-4abe-abaa-b40278e665f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Volume 79616c7a-6e92-49e2-9978-f7921202a924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79616c7a-6e92-49e2-9978-f7921202a924', 'volume_size': 1}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1892194171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79616c7a-6e92-49e2-9978-f7921202a924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a1c03c20be42aba39a82941f961760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:46Z,use_quota=True,user_id='881a3993aa7a4b1ab65b059ea2f4c971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Creating volume 79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:45 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:25:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:45 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 1073741824
Sep 11 06:25:45 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:46 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 1073741824" returned: 0 in 0.858s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:46 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=131,cinder:UPDATE=171,cinder:INSERT=47,cinder:DELETE=17 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:25:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:46 devstack sudo[100228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924
Sep 11 06:25:46 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:47 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924" returned: 0 in 0.509s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:25:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8001ee7c-4208-4abe-abaa-b40278e665f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79616c7a-6e92-49e2-9978-f7921202a924', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5aabc3b-7eff-421f-9040-7a43c9edb62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:47 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Volume volume-79616c7a-6e92-49e2-9978-f7921202a924 (79616c7a-6e92-49e2-9978-f7921202a924): created successfully
Sep 11 06:25:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5aabc3b-7eff-421f-9040-7a43c9edb62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Flow 'volume_create_manager' (8bfc3c3c-30bb-4461-9be6-f1a5074568b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d2477062-715f-4429-9445-d95dbaba4a95 tempest-VolumesDeleteCascade-337339319 None] Created volume successfully.
Sep 11 06:25:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Creating offline snapshot 2cea2620-0cf6-4c42-bc6e-c8df56b10b6b of volume 79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:25:48 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f87969-af19-40e0-97c4-87db13cb6e95]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:48 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924
Sep 11 06:25:48 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:49 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924" returned: 0 in 0.791s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:49 devstack sudo[100277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b 1G
Sep 11 06:25:49 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:50 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b 1G" returned: 0 in 0.832s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79616c7a-6e92-49e2-9978-f7921202a924 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:50 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79616c7a-6e92-49e2-9978-f7921202a924 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b
Sep 11 06:25:50 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:50 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79616c7a-6e92-49e2-9978-f7921202a924 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" returned: 0 in 0.512s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:50 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b is being set with open permissions: ugo+rw
Sep 11 06:25:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:50 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b
Sep 11 06:25:50 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:50 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" returned: 0 in 0.404s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:51 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.info
Sep 11 06:25:51 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:51 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.info" returned: 0 in 0.304s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:51 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.info is being set with open permissions: ugo+rw
Sep 11 06:25:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:51 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.info
Sep 11 06:25:51 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:51 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.info" returned: 0 in 0.353s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.337s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f0f40379-2806-4a83-83af-adfc1c71155e tempest-VolumesDeleteCascade-337339319 None] Create snapshot completed successfully
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Flow 'volume_create_manager' (5efe09c7-51db-4c27-beaa-2c3b2d5e2e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6191f8-259c-4d39-b8b9-eb3db24718d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6191f8-259c-4d39-b8b9-eb3db24718d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2058632699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3de13c7-f3df-4d97-801b-aa3442b438f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a1c03c20be42aba39a82941f961760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2cea2620-0cf6-4c42-bc6e-c8df56b10b6b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:25:53Z,use_quota=True,user_id='881a3993aa7a4b1ab65b059ea2f4c971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cdfc48-93f4-43ec-b80c-35be65328206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cdfc48-93f4-43ec-b80c-35be65328206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e269b4-ffa5-4883-9166-14e0593b6df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e269b4-ffa5-4883-9166-14e0593b6df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3de13c7-f3df-4d97-801b-aa3442b438f1', 'volume_name': 'volume-f3de13c7-f3df-4d97-801b-aa3442b438f1', 'volume_size': 1, 'snapshot_id': '2cea2620-0cf6-4c42-bc6e-c8df56b10b6b'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3683cf4f-7369-48d4-a53b-eb76d6a2ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3683cf4f-7369-48d4-a53b-eb76d6a2ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86f3924-1f04-4f96-9823-780fa2f4fc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:25:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Volume f3de13c7-f3df-4d97-801b-aa3442b438f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3de13c7-f3df-4d97-801b-aa3442b438f1', 'volume_size': 1, 'snapshot_id': '2cea2620-0cf6-4c42-bc6e-c8df56b10b6b'}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b-f3de13c7-f3df-4d97-801b-aa3442b438f1" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b-f3de13c7-f3df-4d97-801b-aa3442b438f1" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Creating volume f3de13c7-f3df-4d97-801b-aa3442b438f1 from snapshot 2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-f3de13c7-f3df-4d97-801b-aa3442b438f1" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-f3de13c7-f3df-4d97-801b-aa3442b438f1" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] snapshot: 2cea2620-0cf6-4c42-bc6e-c8df56b10b6b, volume: f3de13c7-f3df-4d97-801b-aa3442b438f1,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d0e8b1-1bc5-4f02-8fdd-1833c8ba4bf5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:53 devstack sudo[100325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b
Sep 11 06:25:53 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:53 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" returned: 0 in 0.450s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79616c7a-6e92-49e2-9978-f7921202a924(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa27819-c55f-42b9-89fc-bfaa43be69f1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:25:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:54 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924
Sep 11 06:25:54 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:25:54 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Sep 11 06:25:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924" returned: 0 in 0.447s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:25:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:25:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:25:54 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:25:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:25:54 devstack sudo[100336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1
Sep 11 06:25:54 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:00 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1" returned: 0 in 6.244s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:00 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:26:00 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Converted 1024.00 MB image at 163.94 MB/s
Sep 11 06:26:00 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 is being set with open permissions: ugo+rw
Sep 11 06:26:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:00 devstack sudo[100354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1
Sep 11 06:26:00 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:00 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-f3de13c7-f3df-4d97-801b-aa3442b438f1" released by "_copy_volume_from_snapshot" :: held 7.536s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b-f3de13c7-f3df-4d97-801b-aa3442b438f1" released by "_create_volume_from_snapshot" :: held 7.631s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.653s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86f3924-1f04-4f96-9823-780fa2f4fc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3de13c7-f3df-4d97-801b-aa3442b438f1', 'volume_size': 1, 'snapshot_id': '2cea2620-0cf6-4c42-bc6e-c8df56b10b6b'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ed4036-2993-49e8-b586-6fac9f7dbc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:01 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Volume volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 (f3de13c7-f3df-4d97-801b-aa3442b438f1): created successfully
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ed4036-2993-49e8-b586-6fac9f7dbc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Flow 'volume_create_manager' (5efe09c7-51db-4c27-beaa-2c3b2d5e2e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:01 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-31b87ac3-9711-4ad7-bc5e-c41b29475b85 tempest-VolumesDeleteCascade-337339319 None] Created volume successfully.
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Flow 'volume_create_manager' (d76c3a3b-fbf9-448d-b35b-7e8a969e001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d6df9b-fb27-4411-b782-b1b2d276ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d6df9b-fb27-4411-b782-b1b2d276ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1480862973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c280fcba-59b0-4640-ba5c-77f1226a8993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a48a36a2f646ca870264060318f92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:01Z,use_quota=True,user_id='ea458460cd294f1daab9db68a3b67759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7291ecc3-c5d1-45c5-ab2b-833e9a8c7742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7291ecc3-c5d1-45c5-ab2b-833e9a8c7742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1629aa61-9b0f-46e6-a783-88610d619d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1629aa61-9b0f-46e6-a783-88610d619d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c280fcba-59b0-4640-ba5c-77f1226a8993', 'volume_name': 'volume-c280fcba-59b0-4640-ba5c-77f1226a8993', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaab29eb-2b90-462d-b1af-86e6854f2ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaab29eb-2b90-462d-b1af-86e6854f2ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb295c08-7e74-4d8c-a0ba-593207126251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:01 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Volume c280fcba-59b0-4640-ba5c-77f1226a8993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c280fcba-59b0-4640-ba5c-77f1226a8993', 'volume_size': 1}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1480862973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c280fcba-59b0-4640-ba5c-77f1226a8993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a48a36a2f646ca870264060318f92e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:01Z,use_quota=True,user_id='ea458460cd294f1daab9db68a3b67759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Creating volume c280fcba-59b0-4640-ba5c-77f1226a8993 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:26:01 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:26:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:01 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993 1073741824
Sep 11 06:26:01 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-79616c7a-6e92-49e2-9978-f7921202a924-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-79616c7a-6e92-49e2-9978-f7921202a924-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:02 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Performing cascade delete. {{(pid=88109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993 1073741824" returned: 0 in 0.798s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-79616c7a-6e92-49e2-9978-f7921202a924" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-79616c7a-6e92-49e2-9978-f7921202a924" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:02 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993
Sep 11 06:26:02 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Deleting offline snapshot 2cea2620-0cf6-4c42-bc6e-c8df56b10b6b of volume 79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] snapshot_file for this snap is: volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f686e8df-5c0b-4f0b-9029-9e8f93d70e50]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:02 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b
Sep 11 06:26:02 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:02 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993" returned: 0 in 0.327s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb295c08-7e74-4d8c-a0ba-593207126251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c280fcba-59b0-4640-ba5c-77f1226a8993', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e276d24-2df7-41d3-b201-d75863cb790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:02 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Volume volume-c280fcba-59b0-4640-ba5c-77f1226a8993 (c280fcba-59b0-4640-ba5c-77f1226a8993): created successfully
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e276d24-2df7-41d3-b201-d75863cb790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Flow 'volume_create_manager' (d76c3a3b-fbf9-448d-b35b-7e8a969e001d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-86d0ba9e-ec13-406b-9de8-57444b1debf8 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Created volume successfully.
Sep 11 06:26:03 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" returned: 0 in 0.444s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79616c7a-6e92-49e2-9978-f7921202a924(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90cc5c2-c338-4bcf-99a8-6d1993f99a98]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:03 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924
Sep 11 06:26:03 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:03 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924" returned: 0 in 0.787s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:04 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b
Sep 11 06:26:04 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:04 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" returned: 0 in 0.622s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:04 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b
Sep 11 06:26:04 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-5694acf4-9d72-4904-b07f-0ecf4bf70012 req-ce57ea85-9179-4595-9856-ec3b47b62727 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-5694acf4-9d72-4904-b07f-0ecf4bf70012 req-ce57ea85-9179-4595-9856-ec3b47b62727 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-5694acf4-9d72-4904-b07f-0ecf4bf70012 req-ce57ea85-9179-4595-9856-ec3b47b62727 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-5694acf4-9d72-4904-b07f-0ecf4bf70012 req-ce57ea85-9179-4595-9856-ec3b47b62727 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-c280fcba-59b0-4640-ba5c-77f1226a8993', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8174348b-68f2-4909-83e5-bde719173d17', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:26:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-5694acf4-9d72-4904-b07f-0ecf4bf70012 req-ce57ea85-9179-4595-9856-ec3b47b62727 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] attachment_update completed successfully.
Sep 11 06:26:05 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924.2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" returned: 0 in 0.390s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b" released by "_delete_snapshot" :: held 2.392s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-79616c7a-6e92-49e2-9978-f7921202a924" released by "delete_snapshot" :: held 2.428s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Created reservations ['702f5b11-3e82-4d04-91a0-383ee29f7d57', '9ad7cda9-115f-4077-8031-717702f3e551', '256e9938-5c34-4bca-a73d-21239f45a7b9', 'd2dcd9ae-c223-4f61-966a-ef67ef29a192'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Acquiring lock "cinder-2f3c066d-3761-4c8d-8f36-8ef487231094-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Lock "cinder-2f3c066d-3761-4c8d-8f36-8ef487231094-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Acquiring lock "cinder-quobyte-2f3c066d-3761-4c8d-8f36-8ef487231094" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Delete snapshot completed successfully.
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-2cea2620-0cf6-4c42-bc6e-c8df56b10b6b-delete_snapshot" released by "delete_snapshot" :: held 2.737s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Snapshots deleted, issuing volume delete {{(pid=88109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-79616c7a-6e92-49e2-9978-f7921202a924" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Lock "cinder-quobyte-2f3c066d-3761-4c8d-8f36-8ef487231094" acquired by "delete_volume" :: waited 0.039s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-79616c7a-6e92-49e2-9978-f7921202a924" acquired by "delete_volume" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95c4a9-ec72-48ba-b187-e3cd8bb25caa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac074b5c-2294-402c-be81-7942871db5be]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:05 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094
Sep 11 06:26:05 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:05 devstack sudo[100779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924
Sep 11 06:26:05 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:05 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094" returned: 0 in 0.515s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:05 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094
Sep 11 06:26:05 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:06 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924" returned: 0 in 0.664s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:06 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924
Sep 11 06:26:06 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:06 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2f3c066d-3761-4c8d-8f36-8ef487231094" returned: 0 in 0.341s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Lock "cinder-quobyte-2f3c066d-3761-4c8d-8f36-8ef487231094" released by "delete_volume" :: held 0.954s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Created reservations ['a5274577-2e2e-40a3-aad2-080a7072649e', '1ebeaeab-7146-40db-9f30-7b962008b4c0', '3b4da3da-f15a-4621-a602-b52e86b9e378', 'bde64413-e0df-4fee-aa60-5f30a4f7bf7c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:06 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-79616c7a-6e92-49e2-9978-f7921202a924" returned: 0 in 0.307s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-79616c7a-6e92-49e2-9978-f7921202a924" released by "delete_volume" :: held 1.061s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:06 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:26:06 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Created reservations ['edaddd51-c0ca-4343-9aba-83c5abf3133c', '369e04a4-6359-43ab-8096-e9abe52815eb', '15ad70b6-ffb1-41e3-a155-1eb2fec20b55', '3c5df89f-b0cc-4e56-b6eb-dac3c02e6f89'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:06 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:26:06 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:06 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.302s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:26:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Deleted volume successfully.
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f16d5b79-acb1-40aa-8c55-438811cc971f tempest-VolumesNegativeTest-338062390 None] Lock "cinder-2f3c066d-3761-4c8d-8f36-8ef487231094-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:06 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.273s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:26:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Deleted volume successfully.
Sep 11 06:26:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-389028d4-7ca4-4ad3-bfea-75d6424c53df tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-79616c7a-6e92-49e2-9978-f7921202a924-delete_volume" released by "delete_volume" :: held 4.459s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-f3de13c7-f3df-4d97-801b-aa3442b438f1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-f3de13c7-f3df-4d97-801b-aa3442b438f1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "cinder-quobyte-f3de13c7-f3df-4d97-801b-aa3442b438f1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-f3de13c7-f3df-4d97-801b-aa3442b438f1" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31eaf3e-9438-409d-9194-dd63bf3c6b5d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:07 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1
Sep 11 06:26:07 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:07 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1" returned: 0 in 0.477s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:07 devstack sudo[100810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1
Sep 11 06:26:07 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:08 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3de13c7-f3df-4d97-801b-aa3442b438f1" returned: 0 in 0.340s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-quobyte-f3de13c7-f3df-4d97-801b-aa3442b438f1" released by "delete_volume" :: held 0.871s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Created reservations ['ba9e68d6-88cd-4141-9657-5993a13a9489', 'ad865600-56a4-4ee0-87f6-60e85805781e', 'eb78512f-7339-48e1-a0c1-70df05a143cb', '8d271f18-8695-4769-a63c-712a1abcb8f9'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:08 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:26:08 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:08 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.427s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:26:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Deleted volume successfully.
Sep 11 06:26:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-fd2f921a-1c3e-45fb-a028-14130ae532a3 req-dc178399-0611-424c-8025-00a6815956c1 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Terminate volume connection completed successfully.
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-fd2f921a-1c3e-45fb-a028-14130ae532a3 req-dc178399-0611-424c-8025-00a6815956c1 tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Deleting attachment 8174348b-68f2-4909-83e5-bde719173d17. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:26:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb3f3d2b-2c35-4fb1-907e-1b6a2eff1aba tempest-VolumesDeleteCascade-337339319 None] Lock "cinder-f3de13c7-f3df-4d97-801b-aa3442b438f1-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Acquiring lock "cinder-c280fcba-59b0-4640-ba5c-77f1226a8993-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "cinder-c280fcba-59b0-4640-ba5c-77f1226a8993-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Acquiring lock "cinder-quobyte-c280fcba-59b0-4640-ba5c-77f1226a8993" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "cinder-quobyte-c280fcba-59b0-4640-ba5c-77f1226a8993" acquired by "delete_volume" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aecc1a-a0fb-4671-a20a-33ba3df39e3d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:10 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993
Sep 11 06:26:10 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:10 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993" returned: 0 in 0.486s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:10 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993
Sep 11 06:26:10 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:10 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c280fcba-59b0-4640-ba5c-77f1226a8993" returned: 0 in 0.355s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "cinder-quobyte-c280fcba-59b0-4640-ba5c-77f1226a8993" released by "delete_volume" :: held 0.890s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Created reservations ['fbf72f62-f6bf-4bcc-851c-6b2bf48dbb2d', '277cfa34-13ce-440a-a1e3-c4a0328ce225', '679dc6d0-19f5-439c-95d5-f98a4aee22e3', '51968fab-1f9e-45dd-8e08-d02ab3bd635e'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:10 devstack sudo[100852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:26:10 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:11 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.476s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:11 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:26:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Deleted volume successfully.
Sep 11 06:26:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d3c892d2-e052-4097-8330-737c286915ee tempest-TestServerVolumeAttachScenarioOldVersion-357995300 None] Lock "cinder-c280fcba-59b0-4640-ba5c-77f1226a8993-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Flow 'volume_create_manager' (462a1db5-f735-41d6-b995-521ba752e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0293e8a-ea5c-46f3-87a8-6b1a7c37eb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0293e8a-ea5c-46f3-87a8-6b1a7c37eb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-339874646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7374f270-8c35-4d5b-bb20-c2a98fa2ad21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22af14bcac334e05b16e2c62faab6414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:13Z,use_quota=True,user_id='ac3239c664c54732be5041c3c454db23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf10f0e-1e01-4a68-8461-cef1a6550ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf10f0e-1e01-4a68-8461-cef1a6550ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d210e156-4c88-4535-80cf-7cc36ff5a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d210e156-4c88-4535-80cf-7cc36ff5a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7374f270-8c35-4d5b-bb20-c2a98fa2ad21', 'volume_name': 'volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ff5dc7-6010-4fee-bec5-963029bfe462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ff5dc7-6010-4fee-bec5-963029bfe462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90ddd62-b501-49d1-aab4-ee6d0fe4f38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21', 'volume_size': 1}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-339874646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7374f270-8c35-4d5b-bb20-c2a98fa2ad21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22af14bcac334e05b16e2c62faab6414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:13Z,use_quota=True,user_id='ac3239c664c54732be5041c3c454db23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Creating volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:26:12 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:26:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:12 devstack sudo[100876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 1073741824
Sep 11 06:26:12 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:13 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 1073741824" returned: 0 in 0.609s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:13 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21
Sep 11 06:26:13 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:13 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" returned: 0 in 0.317s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90ddd62-b501-49d1-aab4-ee6d0fe4f38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d863cea2-ac51-434b-b924-b2059490d99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Volume volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 (7374f270-8c35-4d5b-bb20-c2a98fa2ad21): created successfully
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d863cea2-ac51-434b-b924-b2059490d99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Flow 'volume_create_manager' (462a1db5-f735-41d6-b995-521ba752e157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-99745775-816e-4dbc-8c14-6f780202b911 tempest-VolumesSnapshotListTestJSON-1312180639 None] Created volume successfully.
Sep 11 06:26:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Creating offline snapshot 5651a1a2-0739-4ae1-abcf-d3573d19ca82 of volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:26:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f8cc37-034a-465f-919c-c723b994ee32]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:15 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21
Sep 11 06:26:15 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:15 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" returned: 0 in 0.439s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:15 devstack sudo[100893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 1G
Sep 11 06:26:15 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:15 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 1G" returned: 0 in 0.460s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:15 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82
Sep 11 06:26:15 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:16 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82" returned: 0 in 0.378s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:16 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 is being set with open permissions: ugo+rw
Sep 11 06:26:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:16 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82
Sep 11 06:26:16 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:16 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82" returned: 0 in 0.327s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:16 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.info
Sep 11 06:26:16 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:16 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.info" returned: 0 in 0.278s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:16 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.info is being set with open permissions: ugo+rw
Sep 11 06:26:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:16 devstack sudo[100910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.info
Sep 11 06:26:16 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:17 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.info" returned: 0 in 0.295s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.335s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-36a3690c-dfb6-42d0-8013-69ec55df7b85 tempest-VolumesSnapshotListTestJSON-1312180639 None] Create snapshot completed successfully
Sep 11 06:26:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Creating offline snapshot ad6bdd57-bf04-40a7-b87b-9459b162e903 of volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:26:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4d1b9-92b0-426b-ab2b-b315491c861b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:18 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82
Sep 11 06:26:18 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:18 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82" returned: 0 in 0.497s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:19 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 1G
Sep 11 06:26:19 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:19 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 1G" returned: 0 in 0.599s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:19 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903
Sep 11 06:26:19 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:19 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903" returned: 0 in 0.392s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:19 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 is being set with open permissions: ugo+rw
Sep 11 06:26:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:20 devstack sudo[100930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903
Sep 11 06:26:20 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:20 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903" returned: 0 in 0.337s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b17e2dc2-7628-4512-850f-22195ebd5042 tempest-VolumesSnapshotListTestJSON-1312180639 None] Create snapshot completed successfully
Sep 11 06:26:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Creating offline snapshot c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 of volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:26:21 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c34e4f8-732f-4c33-a4a0-995ab196e5a8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:22 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903
Sep 11 06:26:22 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:22 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903" returned: 0 in 0.409s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:22 devstack sudo[100939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 1G
Sep 11 06:26:22 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:22 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 1G" returned: 0 in 0.606s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:22 devstack sudo[100945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861
Sep 11 06:26:22 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:23 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" returned: 0 in 0.431s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:23 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 is being set with open permissions: ugo+rw
Sep 11 06:26:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:23 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861
Sep 11 06:26:23 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:23 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-37c81312-43c8-481d-bd5f-55ee2543f462 tempest-VolumesSnapshotListTestJSON-1312180639 None] Create snapshot completed successfully
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-c497ae50-fe37-4fa9-99b9-0c1cd5ef8861-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-c497ae50-fe37-4fa9-99b9-0c1cd5ef8861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-quobyte-c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Deleting offline snapshot c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 of volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] snapshot_file for this snap is: volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6853e030-6460-44ea-9a15-01079e0b55d6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:25 devstack sudo[100954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861
Sep 11 06:26:25 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:25 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" returned: 0 in 0.630s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd6d923-471b-45a4-8623-317a18dd89cb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:26 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903
Sep 11 06:26:26 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:26 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903" returned: 0 in 0.583s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:26 devstack sudo[100968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861
Sep 11 06:26:26 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:27 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" returned: 0 in 0.789s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:27 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861
Sep 11 06:26:27 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Flow 'volume_create_manager' (72efa672-591e-429b-917e-c4ffeb8486e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5479fa2f-6a75-4ba4-a4b0-b9ff412cdcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5479fa2f-6a75-4ba4-a4b0-b9ff412cdcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-855976667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eead871-07d7-45d8-b836-25a1afbec30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffce6e9fea4df59bedd3530c75f6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:27Z,use_quota=True,user_id='6622be1d51184b64bb2c8c6f696656e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a4a209-d839-4eae-aa09-daeb299319f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a4a209-d839-4eae-aa09-daeb299319f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c350a80-8f6a-415d-9d79-543fbf0ee8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c350a80-8f6a-415d-9d79-543fbf0ee8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eead871-07d7-45d8-b836-25a1afbec30f', 'volume_name': 'volume-1eead871-07d7-45d8-b836-25a1afbec30f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d68f0b1-b659-4491-86d4-ab7751316aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d68f0b1-b659-4491-86d4-ab7751316aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174f8758-33b6-4fc6-a7ee-f63971d52f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:27 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Volume 1eead871-07d7-45d8-b836-25a1afbec30f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eead871-07d7-45d8-b836-25a1afbec30f', 'volume_size': 1}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-855976667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eead871-07d7-45d8-b836-25a1afbec30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfffce6e9fea4df59bedd3530c75f6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:27Z,use_quota=True,user_id='6622be1d51184b64bb2c8c6f696656e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Creating volume 1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:26:27 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:27 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f 1073741824
Sep 11 06:26:27 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:27 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" returned: 0 in 0.465s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-c497ae50-fe37-4fa9-99b9-0c1cd5ef8861" released by "_delete_snapshot" :: held 2.636s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" released by "delete_snapshot" :: held 2.671s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Created reservations ['da444938-66e2-4bf9-826f-3e7f5e70cd0d', 'eeab9f1a-395d-4ba0-a166-eb9f50cf4a64', 'c828b77c-c6e8-4ee5-a088-5933fa8cf4da', '4a59fb91-a491-434d-b3aa-a13983bb5256'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Delete snapshot completed successfully.
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-268a83a1-ec3c-40f5-a0f5-4d875cf7430f tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-c497ae50-fe37-4fa9-99b9-0c1cd5ef8861-delete_snapshot" released by "delete_snapshot" :: held 2.938s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:28 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f 1073741824" returned: 0 in 0.798s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-ad6bdd57-bf04-40a7-b87b-9459b162e903-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-ad6bdd57-bf04-40a7-b87b-9459b162e903-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:28 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:26:28 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-quobyte-ad6bdd57-bf04-40a7-b87b-9459b162e903" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-ad6bdd57-bf04-40a7-b87b-9459b162e903" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Deleting offline snapshot ad6bdd57-bf04-40a7-b87b-9459b162e903 of volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] snapshot_file for this snap is: volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[31923430-be29-4c74-9ba3-16754e09149f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:28 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903
Sep 11 06:26:28 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:29 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.538s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174f8758-33b6-4fc6-a7ee-f63971d52f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eead871-07d7-45d8-b836-25a1afbec30f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29224f3-1d2d-4eab-818e-9c846d65ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:29 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Volume volume-1eead871-07d7-45d8-b836-25a1afbec30f (1eead871-07d7-45d8-b836-25a1afbec30f): created successfully
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29224f3-1d2d-4eab-818e-9c846d65ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Flow 'volume_create_manager' (72efa672-591e-429b-917e-c4ffeb8486e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c5913a6c-e07a-47d1-92aa-815525b64cbc tempest-VolumesActionsTest-1478159286 None] Created volume successfully.
Sep 11 06:26:29 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903" returned: 0 in 0.549s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcee079-ed73-4b17-8f2c-2404e3f99e33]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:29 devstack sudo[101035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82
Sep 11 06:26:29 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:29 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82" returned: 0 in 0.552s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:29 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903
Sep 11 06:26:29 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:30 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903" returned: 0 in 0.489s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:30 devstack sudo[101070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903
Sep 11 06:26:30 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:30 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.ad6bdd57-bf04-40a7-b87b-9459b162e903" returned: 0 in 0.426s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-ad6bdd57-bf04-40a7-b87b-9459b162e903" released by "_delete_snapshot" :: held 2.157s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" released by "delete_snapshot" :: held 2.193s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:30 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Created reservations ['896308ca-9792-4f0b-a7f7-4a2d83dd0090', 'd16bdd4c-d669-41ab-bdcd-f3c32e50769a', '472ea7a4-fffb-433b-8090-251d0873dc05', '86308253-8de1-453e-9ca8-167d84d7c7a5'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:31 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Delete snapshot completed successfully.
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-76ce660a-e3de-4c7f-93a5-3aa4c561f811 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-ad6bdd57-bf04-40a7-b87b-9459b162e903-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:31 devstack sudo[101081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:26:31 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:31 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.274s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-5651a1a2-0739-4ae1-abcf-d3573d19ca82-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-5651a1a2-0739-4ae1-abcf-d3573d19ca82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-quobyte-5651a1a2-0739-4ae1-abcf-d3573d19ca82" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-5651a1a2-0739-4ae1-abcf-d3573d19ca82" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Deleting offline snapshot 5651a1a2-0739-4ae1-abcf-d3573d19ca82 of volume 7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] snapshot_file for this snap is: volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a591f3-001e-4e12-b95a-eb75cd9216d2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:32 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82
Sep 11 06:26:32 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:32 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82" returned: 0 in 0.696s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9def012-89bb-4b9d-a6bd-95e850f27234]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:33 devstack sudo[101136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21
Sep 11 06:26:33 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:33 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" returned: 0 in 0.956s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:33 devstack sudo[101166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82
Sep 11 06:26:33 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:34 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82" returned: 0 in 0.649s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:34 devstack sudo[101176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82
Sep 11 06:26:34 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:35 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21.5651a1a2-0739-4ae1-abcf-d3573d19ca82" returned: 0 in 0.633s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-5651a1a2-0739-4ae1-abcf-d3573d19ca82" released by "_delete_snapshot" :: held 3.238s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" released by "delete_snapshot" :: held 3.290s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:35 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Created reservations ['9e451b96-f795-4df9-944d-3aac990e4bf5', '1d14817e-fd40-4737-b62a-6a5d47f164be', 'df8e4fbf-f53f-4219-8454-eaf9b24de933', '926f9fd8-6a47-40a8-9b1a-d348f13c24e6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Delete snapshot completed successfully.
Sep 11 06:26:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-feb78696-1bf7-4474-91cf-1a8668f0aa91 tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-5651a1a2-0739-4ae1-abcf-d3573d19ca82-delete_snapshot" released by "delete_snapshot" :: held 3.632s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-7374f270-8c35-4d5b-bb20-c2a98fa2ad21-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-7374f270-8c35-4d5b-bb20-c2a98fa2ad21-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ba546-741b-402f-8481-bf1581132e6f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:26:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:37 devstack sudo[101197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21
Sep 11 06:26:37 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:37 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" returned: 0 in 0.538s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:37 devstack sudo[101202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21
Sep 11 06:26:37 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:38 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" returned: 0 in 0.572s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-quobyte-7374f270-8c35-4d5b-bb20-c2a98fa2ad21" released by "delete_volume" :: held 1.241s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Created reservations ['38d434bf-e537-4556-b204-e9ad16212a70', 'cc6f3106-977b-4ccb-99e9-8b2c4ab2e112', '7b2e2bed-4729-4186-b6d4-1357873729a6', 'ad9b2dc6-1d7d-4744-9465-34c22e3930f7'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:38 devstack sudo[101206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:26:38 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Flow 'volume_create_manager' (d043df8f-b05d-4ca0-9e4f-d03174ef2e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f751ce-391a-4304-8397-2f7e72c9ab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f751ce-391a-4304-8397-2f7e72c9ab5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1843863468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f03758-13dc-42af-9a7f-dab7dc4c18bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76efecff9f44bf6950e7389cd85f6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:39Z,use_quota=True,user_id='e32cc0e4251b44ca928ea2d3b804bb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19fc921-d1d7-4f16-9029-6a6c3fdd4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19fc921-d1d7-4f16-9029-6a6c3fdd4402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f576e36-0a7c-429a-9309-04f08457d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f576e36-0a7c-429a-9309-04f08457d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f03758-13dc-42af-9a7f-dab7dc4c18bf', 'volume_name': 'volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126b5b57-d4ff-4105-8088-a4c9d17e4ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126b5b57-d4ff-4105-8088-a4c9d17e4ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5b9d8-3de3-405b-a12e-cc4e0320b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:38 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Volume 03f03758-13dc-42af-9a7f-dab7dc4c18bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf', 'volume_size': 1}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1843863468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f03758-13dc-42af-9a7f-dab7dc4c18bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76efecff9f44bf6950e7389cd85f6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:26:39Z,use_quota=True,user_id='e32cc0e4251b44ca928ea2d3b804bb08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Creating volume 03f03758-13dc-42af-9a7f-dab7dc4c18bf {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:26:38 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:38 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.537s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:26:38 devstack sudo[101210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf 1073741824
Sep 11 06:26:38 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Deleted volume successfully.
Sep 11 06:26:38 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8dd3b4da-e005-458f-a06a-5f5e635fb9dc tempest-VolumesSnapshotListTestJSON-1312180639 None] Lock "cinder-7374f270-8c35-4d5b-bb20-c2a98fa2ad21-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:39 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf 1073741824" returned: 0 in 0.823s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:26:39 devstack sudo[101216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf
Sep 11 06:26:39 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:26:40 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root
Sep 11 06:26:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf" returned: 0 in 0.580s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:26:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:26:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5b9d8-3de3-405b-a12e-cc4e0320b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98ae1e9-b1c2-40b4-b9b8-bd0379247d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:26:40 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Volume volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf (03f03758-13dc-42af-9a7f-dab7dc4c18bf): created successfully
Sep 11 06:26:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98ae1e9-b1c2-40b4-b9b8-bd0379247d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:26:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Flow 'volume_create_manager' (d043df8f-b05d-4ca0-9e4f-d03174ef2e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:26:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-14a23f5c-7033-4a46-a529-5399899cc397 tempest-TestMinimumBasicScenario-999839365 None] Created volume successfully.
Sep 11 06:26:43 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=91,cinder:SELECT=75,cinder:INSERT=23,cinder:DELETE=6 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:26:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-08fbf8b1-5eb9-49e0-acdd-48f890a76a39 req-559bcb32-e7dc-49e6-80b9-dc3b7e502d50 tempest-TestMinimumBasicScenario-999839365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:26:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-08fbf8b1-5eb9-49e0-acdd-48f890a76a39 req-559bcb32-e7dc-49e6-80b9-dc3b7e502d50 tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:26:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-08fbf8b1-5eb9-49e0-acdd-48f890a76a39 req-559bcb32-e7dc-49e6-80b9-dc3b7e502d50 tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:26:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-08fbf8b1-5eb9-49e0-acdd-48f890a76a39 req-559bcb32-e7dc-49e6-80b9-dc3b7e502d50 tempest-TestMinimumBasicScenario-999839365 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18ee522b-5eb3-452c-9465-0629a3f4b794', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:26:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-08fbf8b1-5eb9-49e0-acdd-48f890a76a39 req-559bcb32-e7dc-49e6-80b9-dc3b7e502d50 tempest-TestMinimumBasicScenario-999839365 None] attachment_update completed successfully.
Sep 11 06:26:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f2ed624d-e84f-4a78-a864-a61ae2c168e5 tempest-VolumesActionsTest-1478159286 None] Acquiring lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f" by "attach_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f2ed624d-e84f-4a78-a864-a61ae2c168e5 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f" acquired by "attach_volume" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f2ed624d-e84f-4a78-a864-a61ae2c168e5 tempest-VolumesActionsTest-1478159286 None] Attaching volume 1eead871-07d7-45d8-b836-25a1afbec30f to instance 0346b4fe-1f71-470c-8c21-53eab14bc0be at mountpoint /dev/vdb on host None.
Sep 11 06:26:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f2ed624d-e84f-4a78-a864-a61ae2c168e5 tempest-VolumesActionsTest-1478159286 None] Attach volume completed successfully.
Sep 11 06:26:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f2ed624d-e84f-4a78-a864-a61ae2c168e5 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f" released by "attach_volume" :: held 0.234s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6a8227e4-794a-4707-9bb2-1581e8f59035 tempest-VolumesActionsTest-1478159286 None] Acquiring lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-detach_volume" by "detach_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:26:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6a8227e4-794a-4707-9bb2-1581e8f59035 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:26:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6a8227e4-794a-4707-9bb2-1581e8f59035 tempest-VolumesActionsTest-1478159286 None] Detaching volume 1eead871-07d7-45d8-b836-25a1afbec30f from instance 0346b4fe-1f71-470c-8c21-53eab14bc0be.
Sep 11 06:26:46 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=93,cinder:SELECT=93,cinder:DELETE=9,cinder:INSERT=22 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:26:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6a8227e4-794a-4707-9bb2-1581e8f59035 tempest-VolumesActionsTest-1478159286 None] Detach volume completed successfully.
Sep 11 06:26:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6a8227e4-794a-4707-9bb2-1581e8f59035 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:26:57 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:26:57 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Flow 'volume_create_manager' (b272c31e-f80b-4c8c-b986-2ff7ddd2ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59984d32-2c99-482a-ad99-c140226ef279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59984d32-2c99-482a-ad99-c140226ef279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-17067326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873d203d-2fb5-4e86-b48d-5ecdd01bf5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8417bc8cf4c4b589237f8c091956ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:27:16Z,use_quota=True,user_id='ad2dc629e8fa4a1c8f750171d7cc435f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681b8bb0-2a21-4081-9663-6f79428f416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681b8bb0-2a21-4081-9663-6f79428f416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d0a5ab-8559-4293-9635-aa1bdd5a6caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d0a5ab-8559-4293-9635-aa1bdd5a6caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873d203d-2fb5-4e86-b48d-5ecdd01bf5b1', 'volume_name': 'volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7e6e6a-6c5b-4794-a129-ba76c3f11522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7e6e6a-6c5b-4794-a129-ba76c3f11522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf7fe26-f0eb-47b6-a61b-a83702b1150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:16 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Volume 873d203d-2fb5-4e86-b48d-5ecdd01bf5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1', 'volume_size': 1}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-17067326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873d203d-2fb5-4e86-b48d-5ecdd01bf5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8417bc8cf4c4b589237f8c091956ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:27:16Z,use_quota=True,user_id='ad2dc629e8fa4a1c8f750171d7cc435f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Creating volume 873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:27:16 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:16 devstack sudo[101786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 1073741824
Sep 11 06:27:16 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:16 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Flow 'volume_create_manager' (622a0434-f9ec-4256-9ba3-116e9bc9d72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6350d36e-3afd-4b8a-bc5d-4a1ec020710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6350d36e-3afd-4b8a-bc5d-4a1ec020710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1738469354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a28c0af-3698-435e-bc57-578065c81a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8417bc8cf4c4b589237f8c091956ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:27:17Z,use_quota=True,user_id='ad2dc629e8fa4a1c8f750171d7cc435f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd78b84-5220-4eb6-954e-71f9ffd41140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd78b84-5220-4eb6-954e-71f9ffd41140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9120fcfc-4147-4cdd-b1ad-21b1d2803329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9120fcfc-4147-4cdd-b1ad-21b1d2803329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a28c0af-3698-435e-bc57-578065c81a1b', 'volume_name': 'volume-9a28c0af-3698-435e-bc57-578065c81a1b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5d0080-494e-4620-b914-6f34374458fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5d0080-494e-4620-b914-6f34374458fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6347f95b-7334-4496-aa5e-f77e368ef22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Volume 9a28c0af-3698-435e-bc57-578065c81a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a28c0af-3698-435e-bc57-578065c81a1b', 'volume_size': 1}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:17 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 1073741824" returned: 0 in 0.791s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:17 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1
Sep 11 06:27:17 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:17 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1738469354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a28c0af-3698-435e-bc57-578065c81a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8417bc8cf4c4b589237f8c091956ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:27:17Z,use_quota=True,user_id='ad2dc629e8fa4a1c8f750171d7cc435f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Creating volume 9a28c0af-3698-435e-bc57-578065c81a1b {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:27:17 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf7fe26-f0eb-47b6-a61b-a83702b1150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:17 devstack sudo[101795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b 1073741824
Sep 11 06:27:17 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd2564b-2687-4db7-b28c-ae1a8db7b5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Volume volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 (873d203d-2fb5-4e86-b48d-5ecdd01bf5b1): created successfully
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd2564b-2687-4db7-b28c-ae1a8db7b5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Flow 'volume_create_manager' (b272c31e-f80b-4c8c-b986-2ff7ddd2ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:27:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d9666504-260e-462b-a00a-bb8776ada72f tempest-TestServerVolumeAttachmentScenario-172531264 None] Created volume successfully.
Sep 11 06:27:18 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b 1073741824" returned: 0 in 0.565s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:18 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b
Sep 11 06:27:18 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:18 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b" returned: 0 in 0.290s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6347f95b-7334-4496-aa5e-f77e368ef22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a28c0af-3698-435e-bc57-578065c81a1b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac0cb14-6e63-40b2-aef4-6a2d5c12b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:18 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Volume volume-9a28c0af-3698-435e-bc57-578065c81a1b (9a28c0af-3698-435e-bc57-578065c81a1b): created successfully
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac0cb14-6e63-40b2-aef4-6a2d5c12b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Flow 'volume_create_manager' (622a0434-f9ec-4256-9ba3-116e9bc9d72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:27:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-987c3dbf-b53d-4758-bea4-83ee937d1340 tempest-TestServerVolumeAttachmentScenario-172531264 None] Created volume successfully.
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Flow 'volume_create_manager' (07923ea5-f6f0-45ac-a6e3-014f01bc3cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b69eb5-0cde-4b33-a94e-7c48122c529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b69eb5-0cde-4b33-a94e-7c48122c529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2001966220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bb9061-357f-4901-8343-bf8f4c105f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb7a2ad6707459c8d15c0db22118fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:27:23Z,use_quota=True,user_id='a0ce4ef0f6584507818f2b3bb92b3d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e129160c-e3d7-4497-a6eb-7f41076aca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e129160c-e3d7-4497-a6eb-7f41076aca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090623bf-dc72-4fcb-bb85-3ca8fc83d834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:23 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090623bf-dc72-4fcb-bb85-3ca8fc83d834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65bb9061-357f-4901-8343-bf8f4c105f69', 'volume_name': 'volume-65bb9061-357f-4901-8343-bf8f4c105f69', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030c9ac410>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbc5bc3-03ce-4638-90bb-da6142fffd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbc5bc3-03ce-4638-90bb-da6142fffd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbc0e42-47ac-4872-9e88-027a45b4dff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:24 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Volume 65bb9061-357f-4901-8343-bf8f4c105f69: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65bb9061-357f-4901-8343-bf8f4c105f69', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030c9ac410>}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Trying to clone 65bb9061-357f-4901-8343-bf8f4c105f69 from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-20b7d879-0ac4-43c0-a176-c6bf7ed053b2 tempest-VolumesActionsTest-1478159286 None] Acquiring lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f" by "attach_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-20b7d879-0ac4-43c0-a176-c6bf7ed053b2 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f" acquired by "attach_volume" :: waited 0.098s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:27:24 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 06:27:24 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-20b7d879-0ac4-43c0-a176-c6bf7ed053b2 tempest-VolumesActionsTest-1478159286 None] Attaching volume 1eead871-07d7-45d8-b836-25a1afbec30f to instance 16d594de-c033-4455-9be9-ae9baa7ca8f2 at mountpoint /dev/vdb on host None.
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ad0fd-6df7-49b9-9ae5-761bb1b19d50]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:27:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-20b7d879-0ac4-43c0-a176-c6bf7ed053b2 tempest-VolumesActionsTest-1478159286 None] Attach volume completed successfully.
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-20b7d879-0ac4-43c0-a176-c6bf7ed053b2 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f" released by "attach_volume" :: held 0.404s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:27:25 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD
Sep 11 06:27:25 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:25 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD" returned: 0 in 0.616s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 is fetched for user a0ce4ef0f6584507818f2b3bb92b3d55. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44284cc9-397e-42c2-9803-d248a998125e tempest-VolumesActionsTest-1478159286 None] Acquiring lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-detach_volume" by "detach_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44284cc9-397e-42c2-9803-d248a998125e tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:27:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-44284cc9-397e-42c2-9803-d248a998125e tempest-VolumesActionsTest-1478159286 None] Detaching volume 1eead871-07d7-45d8-b836-25a1afbec30f from instance 16d594de-c033-4455-9be9-ae9baa7ca8f2.
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[786b85c3-1eec-4a0d-abd3-2d63af73a14f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-44284cc9-397e-42c2-9803-d248a998125e tempest-VolumesActionsTest-1478159286 None] Detach volume completed successfully.
Sep 11 06:27:25 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-44284cc9-397e-42c2-9803-d248a998125e tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:27:25 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD
Sep 11 06:27:25 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:26 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2001966220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bb9061-357f-4901-8343-bf8f4c105f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb7a2ad6707459c8d15c0db22118fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:27:23Z,use_quota=True,user_id='a0ce4ef0f6584507818f2b3bb92b3d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Creating volume 65bb9061-357f-4901-8343-bf8f4c105f69 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:27:26 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:27:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:26 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 1073741824
Sep 11 06:27:26 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:27 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 1073741824" returned: 0 in 1.078s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:27 devstack sudo[101929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69
Sep 11 06:27:27 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:27 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69" returned: 0 in 0.383s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Attempting download of 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume 65bb9061-357f-4901-8343-bf8f4c105f69. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b0ae1-024a-43a7-98c8-f5f295664b3f]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:27:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_w0xtq9sr {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:28 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_w0xtq9sr
Sep 11 06:27:28 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:28 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_w0xtq9sr" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_w0xtq9sr {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:28 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_w0xtq9sr
Sep 11 06:27:28 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:28 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_w0xtq9sr" returned: 1 in 0.407s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02c3cc94-2cbe-438e-96aa-813e3f248ce8_w0xtq9sr' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:27:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e457db4-0762-41ad-ab0f-d961596a36e5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:27:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:28 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD
Sep 11 06:27:28 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:29 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:29 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] 02c3cc94-2cbe-438e-96aa-813e3f248ce8 was qcow2, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:27:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:29 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69
Sep 11 06:27:29 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:31 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:27:31 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:31 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.626s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:27:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:27:32 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69" returned: 0 in 3.359s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:32 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02c3cc94-2cbe-438e-96aa-813e3f248ce8_i6zrf5ibdevstack@QuobyteHD, size 112.00 MB, duration 3.36 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:27:32 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Converted 112.00 MB image at 33.33 MB/s
Sep 11 06:27:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:32 devstack sudo[102095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 1G
Sep 11 06:27:32 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:33 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 1G" returned: 0 in 0.761s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Downloaded image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 ((None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}])) to volume 65bb9061-357f-4901-8343-bf8f4c105f69 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Temporary image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 for user a0ce4ef0f6584507818f2b3bb92b3d55 is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Marking volume 65bb9061-357f-4901-8343-bf8f4c105f69 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Copying metadata from image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 to 65bb9061-357f-4901-8343-bf8f4c105f69. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Creating volume glance metadata for volume 65bb9061-357f-4901-8343-bf8f4c105f69 backed by image 02c3cc94-2cbe-438e-96aa-813e3f248ce8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d93d57-5822-49ff-8063-92d417267b48]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbc0e42-47ac-4872-9e88-027a45b4dff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bb9061-357f-4901-8343-bf8f4c105f69', 'volume_size': 1, 'image_id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ebb99f074a3941efada292d3e0d2154d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02c3cc94-2cbe-438e-96aa-813e3f248ce8', 'created_at': datetime.datetime(2026, 9, 11, 4, 9, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02c3cc94-2cbe-438e-96aa-813e3f248ce8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030c9ac410>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e51d72-26bd-4333-b3c1-8db1c66df2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:27:33 devstack sudo[102101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:27:33 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:33 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Volume volume-65bb9061-357f-4901-8343-bf8f4c105f69 (65bb9061-357f-4901-8343-bf8f4c105f69): created successfully
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e51d72-26bd-4333-b3c1-8db1c66df2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Flow 'volume_create_manager' (07923ea5-f6f0-45ac-a6e3-014f01bc3cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:27:33 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-247e650a-a6a4-4968-a906-82d2230b47c0 tempest-TestShelveInstance-62893784 None] Created volume successfully.
Sep 11 06:27:33 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.649s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d229b21-3068-44cb-a9cd-00fad01a1904]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:27:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:34 devstack sudo[102106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:27:34 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:34 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.531s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.39473954-2acc-459d-8f54-a1d9d58ed92ezcwiwa36.img {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:34 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.39473954-2acc-459d-8f54-a1d9d58ed92ezcwiwa36.img
Sep 11 06:27:34 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:42 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.39473954-2acc-459d-8f54-a1d9d58ed92ezcwiwa36.img" returned: 0 in 8.493s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:43 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2470d2f5-3eb1-41cb-8ce9-3f6ca48ce9a2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:27:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:27:43 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:27:43 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:27:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-26241b4b-d957-4ae6-a424-c4542c2d6e23 req-cb625242-019e-48df-bc7b-0df35a8ad69a tempest-TestShelveInstance-62893784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:27:44 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Sep 11 06:27:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.986s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:27:44 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f, size 1024.00 MB, duration 8.50 sec, destination /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.39473954-2acc-459d-8f54-a1d9d58ed92ezcwiwa36.img {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:27:44 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Converted 1024.00 MB image at 120.51 MB/s
Sep 11 06:27:44 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] 39473954-2acc-459d-8f54-a1d9d58ed92e was raw, no need to convert to raw {{(pid=88109) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 11 06:27:54 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=26,cinder:UPDATE=14,cinder:INSERT=8 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:27:54 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=14,cinder:SELECT=20,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:28:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e4470627-d0d1-48dd-bebd-91b7fb86af58 req-5763251e-f901-4a2d-9933-c552e2fd5a66 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.280s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Uploaded volume to glance image-id: 39473954-2acc-459d-8f54-a1d9d58ed92e. {{(pid=88109) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-26241b4b-d957-4ae6-a424-c4542c2d6e23 req-cb625242-019e-48df-bc7b-0df35a8ad69a tempest-TestShelveInstance-62893784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.061s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-26241b4b-d957-4ae6-a424-c4542c2d6e23 req-cb625242-019e-48df-bc7b-0df35a8ad69a tempest-TestShelveInstance-62893784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e4470627-d0d1-48dd-bebd-91b7fb86af58 req-5763251e-f901-4a2d-9933-c552e2fd5a66 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.854s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cd1edcc4-7019-43eb-9827-3cce5a67270e tempest-VolumesActionsTest-1478159286 None] Copy volume to image completed successfully.
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-e4470627-d0d1-48dd-bebd-91b7fb86af58 req-5763251e-f901-4a2d-9933-c552e2fd5a66 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-26241b4b-d957-4ae6-a424-c4542c2d6e23 req-cb625242-019e-48df-bc7b-0df35a8ad69a tempest-TestShelveInstance-62893784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-65bb9061-357f-4901-8343-bf8f4c105f69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de8141ee-dc12-43de-843d-74a9642bea2c', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:28:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-e4470627-d0d1-48dd-bebd-91b7fb86af58 req-5763251e-f901-4a2d-9933-c552e2fd5a66 tempest-TestServerVolumeAttachmentScenario-172531264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff9b345a-e67a-46f4-b642-6b7c04e4dfca', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:28:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-26241b4b-d957-4ae6-a424-c4542c2d6e23 req-cb625242-019e-48df-bc7b-0df35a8ad69a tempest-TestShelveInstance-62893784 None] attachment_update completed successfully.
Sep 11 06:28:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-e4470627-d0d1-48dd-bebd-91b7fb86af58 req-5763251e-f901-4a2d-9933-c552e2fd5a66 tempest-TestServerVolumeAttachmentScenario-172531264 None] attachment_update completed successfully.
Sep 11 06:28:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b1e6a-ebe5-47d3-b591-6189057c90f2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:06 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:28:06 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:07 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.476s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:07 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f49e6b-a404-42ca-a29b-43e05d4bb727]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:07 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:28:07 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:07 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.559s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:07 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img
Sep 11 06:28:07 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-3cf51f87-9d44-4090-bd0d-67fc25d903da req-56ada43e-40f9-42c6-ac2e-be340c068026 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:15 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img" returned: 0 in 7.671s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9a1f41-0902-4806-a12b-e890eb602060]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:15 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:28:15 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:16 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.813s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:16 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f, size 1024.00 MB, duration 7.67 sec, destination /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:28:16 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Converted 1024.00 MB image at 133.44 MB/s
Sep 11 06:28:16 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] 700612c4-81dc-4c6e-b7e9-06e565e60267 was raw, converting to qcow2 {{(pid=88109) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 11 06:28:16 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eeb62a-e067-4620-ac61-9f3710b908d8]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:16 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img
Sep 11 06:28:16 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:16 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img" returned: 0 in 0.417s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:17 devstack sudo[102338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img
Sep 11 06:28:17 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:17 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img" returned: 1 in 0.597s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:28:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img /opt/stack/data/cinder/conversion/vol_upload_fqr_h5gy {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:17 devstack sudo[102344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img /opt/stack/data/cinder/conversion/vol_upload_fqr_h5gy
Sep 11 06:28:17 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:17 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img /opt/stack/data/cinder/conversion/vol_upload_fqr_h5gy" returned: 0 in 0.409s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:17 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Image conversion details: src /opt/stack/data/cinder/conversion/1eead871-07d7-45d8-b836-25a1afbec30f.temp_image.700612c4-81dc-4c6e-b7e9-06e565e6026716euljx1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fqr_h5gy {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:28:17 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 11 06:28:17 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1e154b-f1df-4021-b979-d63e2dc2668c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fqr_h5gy {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:18 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fqr_h5gy
Sep 11 06:28:18 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-ad2ba225-458b-4818-a5f3-ebd95d65b0c2 req-5f422502-c8e0-4db7-8bc9-5ba1e0e82e41 tempest-TestMinimumBasicScenario-999839365 None] Terminate volume connection completed successfully.
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-ad2ba225-458b-4818-a5f3-ebd95d65b0c2 req-5f422502-c8e0-4db7-8bc9-5ba1e0e82e41 tempest-TestMinimumBasicScenario-999839365 None] Deleting attachment 18ee522b-5eb3-452c-9465-0629a3f4b794. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:28:18 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fqr_h5gy" returned: 0 in 0.370s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Acquiring lock "cinder-03f03758-13dc-42af-9a7f-dab7dc4c18bf-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Lock "cinder-03f03758-13dc-42af-9a7f-dab7dc4c18bf-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Acquiring lock "cinder-quobyte-03f03758-13dc-42af-9a7f-dab7dc4c18bf" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Lock "cinder-quobyte-03f03758-13dc-42af-9a7f-dab7dc4c18bf" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ace2f-e751-495b-b48a-2aeafba4bb57]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:19 devstack sudo[102358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf
Sep 11 06:28:19 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:19 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf" returned: 0 in 0.405s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:19 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf
Sep 11 06:28:19 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:19 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-03f03758-13dc-42af-9a7f-dab7dc4c18bf" returned: 0 in 0.265s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Lock "cinder-quobyte-03f03758-13dc-42af-9a7f-dab7dc4c18bf" released by "delete_volume" :: held 0.718s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Created reservations ['839e7590-6a03-4bac-bad6-c2cd14960849', '8c16269c-c405-44e3-b75f-8f10e6f84ca9', '16a034d7-e676-4d5e-b49c-a470ed0d74d0', 'e24ab1c8-73fe-40fb-99dd-597205fc102e'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:19 devstack sudo[102366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:28:19 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.092s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Uploaded volume to glance image-id: 700612c4-81dc-4c6e-b7e9-06e565e60267. {{(pid=88109) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-3cf51f87-9d44-4090-bd0d-67fc25d903da req-56ada43e-40f9-42c6-ac2e-be340c068026 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.332s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-3cf51f87-9d44-4090-bd0d-67fc25d903da req-56ada43e-40f9-42c6-ac2e-be340c068026 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3c73a2b4-a7c1-4b27-97a9-aecf049a75a9 tempest-VolumesActionsTest-1478159286 None] Copy volume to image completed successfully.
Sep 11 06:28:19 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-3cf51f87-9d44-4090-bd0d-67fc25d903da req-56ada43e-40f9-42c6-ac2e-be340c068026 tempest-TestServerVolumeAttachmentScenario-172531264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-9a28c0af-3698-435e-bc57-578065c81a1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af96fd3d-b914-4df0-9eab-6372590dca1a', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:28:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-3cf51f87-9d44-4090-bd0d-67fc25d903da req-56ada43e-40f9-42c6-ac2e-be340c068026 tempest-TestServerVolumeAttachmentScenario-172531264 None] attachment_update completed successfully.
Sep 11 06:28:20 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.454s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:20 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:28:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Deleted volume successfully.
Sep 11 06:28:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3f43d2b9-8cfa-4ef7-846e-2a9fbe6efa9b tempest-TestMinimumBasicScenario-999839365 None] Lock "cinder-03f03758-13dc-42af-9a7f-dab7dc4c18bf-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Acquiring lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Acquiring lock "cinder-quobyte-1eead871-07d7-45d8-b836-25a1afbec30f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-quobyte-1eead871-07d7-45d8-b836-25a1afbec30f" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e908c7-6646-495d-8a72-60d3cd8b13b4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:21 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:28:21 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:21 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.483s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:21 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f
Sep 11 06:28:21 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:22 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1eead871-07d7-45d8-b836-25a1afbec30f" returned: 0 in 0.354s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-quobyte-1eead871-07d7-45d8-b836-25a1afbec30f" released by "delete_volume" :: held 0.915s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Created reservations ['233a861b-9769-4b6e-b044-14ca83562173', '39c7c015-f81e-45cb-b479-303bc1729bf3', 'dc4a7552-3770-48d8-9205-cdb6c52b4873', 'bbc162d3-ba00-436b-9ae2-ca65a0a9158b'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:22 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:28:22 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:23 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.374s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:23 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:28:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Deleted volume successfully.
Sep 11 06:28:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-383d6b15-0223-4b8d-9be5-6c7db949f8e9 tempest-VolumesActionsTest-1478159286 None] Lock "cinder-1eead871-07d7-45d8-b836-25a1afbec30f-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-1c078e90-3ec9-4ea1-bb57-b19adb56b73d req-f83b36f7-150e-448f-bab1-95b524370da8 tempest-TestServerVolumeAttachmentScenario-172531264 None] Terminate volume connection completed successfully.
Sep 11 06:28:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-1c078e90-3ec9-4ea1-bb57-b19adb56b73d req-f83b36f7-150e-448f-bab1-95b524370da8 tempest-TestServerVolumeAttachmentScenario-172531264 None] Deleting attachment af96fd3d-b914-4df0-9eab-6372590dca1a. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:28:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-d498d685-40fe-4bbf-88f3-4d1911d03a11 req-d052c062-bfc9-4ed6-97c1-8b0841bf9ece tempest-TestServerVolumeAttachmentScenario-172531264 None] Terminate volume connection completed successfully.
Sep 11 06:28:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-d498d685-40fe-4bbf-88f3-4d1911d03a11 req-d052c062-bfc9-4ed6-97c1-8b0841bf9ece tempest-TestServerVolumeAttachmentScenario-172531264 None] Deleting attachment ff9b345a-e67a-46f4-b642-6b7c04e4dfca. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:31 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:28:31 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:31 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.379s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:28:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "cinder-9a28c0af-3698-435e-bc57-578065c81a1b-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-9a28c0af-3698-435e-bc57-578065c81a1b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "cinder-quobyte-9a28c0af-3698-435e-bc57-578065c81a1b" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-quobyte-9a28c0af-3698-435e-bc57-578065c81a1b" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[598e8969-976a-4bde-88be-3f25d88b549d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:32 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b
Sep 11 06:28:32 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:32 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b" returned: 0 in 0.428s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:32 devstack sudo[102490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b
Sep 11 06:28:32 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:33 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a28c0af-3698-435e-bc57-578065c81a1b" returned: 0 in 0.262s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-quobyte-9a28c0af-3698-435e-bc57-578065c81a1b" released by "delete_volume" :: held 0.742s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Created reservations ['40414813-9248-4dcc-adb0-b2d7eac48d22', '4ff4e1ec-5d62-4dd3-b9a6-59bce042502f', 'de375f04-f414-4695-89e0-f14c1b30854a', '7072f3e2-bdde-4e95-8e52-3318a3e296df'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:33 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:28:33 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "cinder-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "cinder-quobyte-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:28:33 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.369s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:28:33 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Deleted volume successfully.
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-quobyte-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1" acquired by "delete_volume" :: waited 0.091s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-07baa134-48c1-49d8-850e-40cb17f7c4a4 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-9a28c0af-3698-435e-bc57-578065c81a1b-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf3036-c3dc-41f3-a2af-219af0f27b54]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:28:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:33 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1
Sep 11 06:28:33 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:34 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1" returned: 0 in 0.408s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:34 devstack sudo[102501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1
Sep 11 06:28:34 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:34 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1" returned: 0 in 0.266s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-quobyte-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1" released by "delete_volume" :: held 0.731s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Created reservations ['f0e31f8a-9cfc-4459-9bcf-97dd3c710643', 'ada19472-1393-4acd-994d-11337cedb7df', '953e10ab-872c-43fe-9cfb-50cd53fedcc8', '866ec942-fe48-42af-80e3-db4fd22b447d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:28:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:28:34 devstack sudo[102504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:28:34 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:28:35 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root
Sep 11 06:28:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.304s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:28:35 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:28:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Deleted volume successfully.
Sep 11 06:28:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e04af7ea-840a-4bcc-b262-889977580f84 tempest-TestServerVolumeAttachmentScenario-172531264 None] Lock "cinder-873d203d-2fb5-4e86-b48d-5ecdd01bf5b1-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:28:44 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=49,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:28:45 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=39,cinder:UPDATE=42,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:28:58 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-732131a6-f03b-494c-8a6a-3f3ccc9c5c69 req-0b494676-cc00-4ed2-852a-78c4b987e89c tempest-TestShelveInstance-62893784 None] Terminate volume connection completed successfully.
Sep 11 06:28:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-732131a6-f03b-494c-8a6a-3f3ccc9c5c69 req-0b494676-cc00-4ed2-852a-78c4b987e89c tempest-TestShelveInstance-62893784 None] Deleting attachment de8141ee-dc12-43de-843d-74a9642bea2c. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Flow 'volume_create_manager' (ca26e7ad-d697-45be-82e7-eefd30dcb842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bee90d2-eea1-4c87-833b-e8529f8adf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bee90d2-eea1-4c87-833b-e8529f8adf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1631161784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0048a9b4-50d1-4b73-b6de-24b6c7b964a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19a7c76ac1645b7aae3f7a93a256630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:29:05Z,use_quota=True,user_id='347413843bb740a694b0777c3d25e680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c4c9c6-c9ec-4066-9afb-6aedc4de8802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c4c9c6-c9ec-4066-9afb-6aedc4de8802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49de86c5-c313-470d-a8d3-fec66255d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49de86c5-c313-470d-a8d3-fec66255d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0048a9b4-50d1-4b73-b6de-24b6c7b964a0', 'volume_name': 'volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cb49a4-09f9-4b36-8698-7b8e95f349db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cb49a4-09f9-4b36-8698-7b8e95f349db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea40f34-78d2-49c3-b767-d350e037436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:05 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Volume 0048a9b4-50d1-4b73-b6de-24b6c7b964a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0', 'volume_size': 1}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1631161784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0048a9b4-50d1-4b73-b6de-24b6c7b964a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19a7c76ac1645b7aae3f7a93a256630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:29:05Z,use_quota=True,user_id='347413843bb740a694b0777c3d25e680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Creating volume 0048a9b4-50d1-4b73-b6de-24b6c7b964a0 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:29:05 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:29:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:05 devstack sudo[102569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 1073741824
Sep 11 06:29:05 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:06 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 1073741824" returned: 0 in 0.585s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:06 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0
Sep 11 06:29:06 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:06 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" returned: 0 in 0.420s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea40f34-78d2-49c3-b767-d350e037436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1f723a-3c51-4860-8561-17de1372adb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:06 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Volume volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 (0048a9b4-50d1-4b73-b6de-24b6c7b964a0): created successfully
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1f723a-3c51-4860-8561-17de1372adb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Flow 'volume_create_manager' (ca26e7ad-d697-45be-82e7-eefd30dcb842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:29:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-34e6a8d2-1c42-4416-858a-51a639b92a25 tempest-TestImageHashVerification-1825623558 None] Created volume successfully.
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a10ce-3653-4f8d-8ec0-0ac006326f47]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:09 devstack sudo[102589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0
Sep 11 06:29:09 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-028cd2f8-bd39-4da7-87ef-a489a7505bde req-1396add5-2fc1-4f02-8193-7e5833c8929c tempest-TestShelveInstance-62893784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:09 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" returned: 0 in 0.578s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa7154c-b552-4410-b1f5-053e38c2cc07]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:10 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0
Sep 11 06:29:10 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:10 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" returned: 0 in 0.529s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 /opt/stack/data/cinder/conversion/0048a9b4-50d1-4b73-b6de-24b6c7b964a0.temp_image.d08184d2-fb23-47f2-90c9-83515a9d3266sey4qkf5.img {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:10 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 /opt/stack/data/cinder/conversion/0048a9b4-50d1-4b73-b6de-24b6c7b964a0.temp_image.d08184d2-fb23-47f2-90c9-83515a9d3266sey4qkf5.img
Sep 11 06:29:10 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Flow 'volume_create_manager' (5728777a-28eb-4314-b0a5-6ed9e76b2bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192ebc6a-858c-492b-9b7f-06863777e396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192ebc6a-858c-492b-9b7f-06863777e396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967d883f-6cd9-4dc2-9378-374a8aff3da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd603c5686a4464c876909d518b09a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:29:12Z,use_quota=True,user_id='46b155530ed44fc89a6d07ca61f8343b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d5c3bc-7768-45f2-8da2-75922d5c1c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d5c3bc-7768-45f2-8da2-75922d5c1c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392c8e0b-54e2-449b-813f-e0a8e4ee17bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:11 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:29:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392c8e0b-54e2-449b-813f-e0a8e4ee17bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '967d883f-6cd9-4dc2-9378-374a8aff3da5', 'volume_name': 'volume-967d883f-6cd9-4dc2-9378-374a8aff3da5', 'volume_size': 1, 'image_id': '1642b9b1-4d10-44bb-a231-1e4ac636055c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1642b9b1-4d10-44bb-a231-1e4ac636055c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03cfbd0edd349fb914cc0bd609f4a343', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd603c5686a4464c876909d518b09a15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '297759fe6d68d60eb48c4efcd55a5624b2f55e1169207afbf036416c574988fbf718b8f82b8433965aa1510e7391de96ea18080b034a15de62862ba0a2f69184', 'id': '1642b9b1-4d10-44bb-a231-1e4ac636055c', 'created_at': datetime.datetime(2026, 9, 11, 4, 29, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 29, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1642b9b1-4d10-44bb-a231-1e4ac636055c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316d99820>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca75b33d-9961-49b7-8515-d4cfff5932b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca75b33d-9961-49b7-8515-d4cfff5932b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def21c46-fb73-4d42-838d-e73bbba26271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Volume 967d883f-6cd9-4dc2-9378-374a8aff3da5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-967d883f-6cd9-4dc2-9378-374a8aff3da5', 'volume_size': 1, 'image_id': '1642b9b1-4d10-44bb-a231-1e4ac636055c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1642b9b1-4d10-44bb-a231-1e4ac636055c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03cfbd0edd349fb914cc0bd609f4a343', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd603c5686a4464c876909d518b09a15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '297759fe6d68d60eb48c4efcd55a5624b2f55e1169207afbf036416c574988fbf718b8f82b8433965aa1510e7391de96ea18080b034a15de62862ba0a2f69184', 'id': '1642b9b1-4d10-44bb-a231-1e4ac636055c', 'created_at': datetime.datetime(2026, 9, 11, 4, 29, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 29, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1642b9b1-4d10-44bb-a231-1e4ac636055c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316d99820>}
Sep 11 06:29:12 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Trying to clone 967d883f-6cd9-4dc2-9378-374a8aff3da5 from image 1642b9b1-4d10-44bb-a231-1e4ac636055c at location (None, [{'url': 'file:///opt/stack/data/glance/images/1642b9b1-4d10-44bb-a231-1e4ac636055c', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:29:13 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:29:13 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 06:29:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b985ff24-a2bc-4dda-8727-7cbd4a38af00]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:13 devstack sudo[102613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD
Sep 11 06:29:13 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:14 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD" returned: 0 in 0.714s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:14 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD
Sep 11 06:29:14 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:15 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD" returned: 1 in 0.975s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:29:15 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Temporary image 1642b9b1-4d10-44bb-a231-1e4ac636055c is fetched for user 46b155530ed44fc89a6d07ca61f8343b. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:29:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[05428732-b1ab-48c7-91e4-2e2333be5c9e]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:15 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD
Sep 11 06:29:15 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:15 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD" returned: 0 in 0.696s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:16 devstack sudo[102626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD
Sep 11 06:29:16 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:16 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 /opt/stack/data/cinder/conversion/0048a9b4-50d1-4b73-b6de-24b6c7b964a0.temp_image.d08184d2-fb23-47f2-90c9-83515a9d3266sey4qkf5.img" returned: 0 in 5.777s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7c7d58-7b72-4a82-9586-1deeddb2f864]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:16 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD" returned: 1 in 0.460s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:16 devstack sudo[102628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0
Sep 11 06:29:16 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:16 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" returned: 0 in 0.626s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/conversion/0048a9b4-50d1-4b73-b6de-24b6c7b964a0.temp_image.d08184d2-fb23-47f2-90c9-83515a9d3266sey4qkf5.img {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:29:16 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Converted 1024.00 MB image at 177.22 MB/s
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Flow 'volume_create_manager' (2344af5b-9adf-4738-9d39-c426d287b19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002c7d5e-92d2-4d8b-b75a-878e3a2bd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:16 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] d08184d2-fb23-47f2-90c9-83515a9d3266 was raw, no need to convert to raw {{(pid=88109) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002c7d5e-92d2-4d8b-b75a-878e3a2bd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-989865810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3853e695-dcce-4367-8da8-28dc7d5aa275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040e03b2b7db4a48a1c9738a1e405968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:29:17Z,use_quota=True,user_id='bebd185b72104d60a2399ca4efa1dcd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8fe10a-0501-4411-80f6-3abce1d71dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8fe10a-0501-4411-80f6-3abce1d71dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051d12fa-e879-4649-8b24-0aca35579244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051d12fa-e879-4649-8b24-0aca35579244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3853e695-dcce-4367-8da8-28dc7d5aa275', 'volume_name': 'volume-3853e695-dcce-4367-8da8-28dc7d5aa275', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a27d2c-428d-45f6-a555-bb04eebfb038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a27d2c-428d-45f6-a555-bb04eebfb038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ceebd-224e-4f31-b73d-44a862d809bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Volume 3853e695-dcce-4367-8da8-28dc7d5aa275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3853e695-dcce-4367-8da8-28dc7d5aa275', 'volume_size': 1}
Sep 11 06:29:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:26 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:29:27 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:31 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:29:31 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:31 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.356s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:29:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.236s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Uploaded volume to glance image-id: d08184d2-fb23-47f2-90c9-83515a9d3266. {{(pid=88109) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-028cd2f8-bd39-4da7-87ef-a489a7505bde req-1396add5-2fc1-4f02-8193-7e5833c8929c tempest-TestShelveInstance-62893784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 29.947s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-028cd2f8-bd39-4da7-87ef-a489a7505bde req-1396add5-2fc1-4f02-8193-7e5833c8929c tempest-TestShelveInstance-62893784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.209s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967d883f-6cd9-4dc2-9378-374a8aff3da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd603c5686a4464c876909d518b09a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:29:12Z,use_quota=True,user_id='46b155530ed44fc89a6d07ca61f8343b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Creating volume 967d883f-6cd9-4dc2-9378-374a8aff3da5 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:29:39 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f5cd6f1a-224f-4608-89f9-df6a25f07ea7 tempest-TestImageHashVerification-1825623558 None] Copy volume to image completed successfully.
Sep 11 06:29:39 devstack sudo[102783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 1073741824
Sep 11 06:29:39 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-028cd2f8-bd39-4da7-87ef-a489a7505bde req-1396add5-2fc1-4f02-8193-7e5833c8929c tempest-TestShelveInstance-62893784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-65bb9061-357f-4901-8343-bf8f4c105f69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '240392bb-c07d-43bd-9953-7019e33ae2c5', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:29:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-028cd2f8-bd39-4da7-87ef-a489a7505bde req-1396add5-2fc1-4f02-8193-7e5833c8929c tempest-TestShelveInstance-62893784 None] attachment_update completed successfully.
Sep 11 06:29:40 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 1073741824" returned: 0 in 0.562s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:40 devstack sudo[102788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5
Sep 11 06:29:40 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:40 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.426s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-989865810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3853e695-dcce-4367-8da8-28dc7d5aa275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040e03b2b7db4a48a1c9738a1e405968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:29:17Z,use_quota=True,user_id='bebd185b72104d60a2399ca4efa1dcd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Creating volume 3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:29:40 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Attempting download of 1642b9b1-4d10-44bb-a231-1e4ac636055c ((None, [{'url': 'file:///opt/stack/data/glance/images/1642b9b1-4d10-44bb-a231-1e4ac636055c', 'metadata': {}}])) to volume 967d883f-6cd9-4dc2-9378-374a8aff3da5. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:29:40 devstack sudo[102791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 1073741824
Sep 11 06:29:40 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23af9d0-daeb-4928-9a91-acba9a1f5fd5]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1642b9b1-4d10-44bb-a231-1e4ac636055c_fochbzni {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Acquiring lock "cinder-0048a9b4-50d1-4b73-b6de-24b6c7b964a0-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Lock "cinder-0048a9b4-50d1-4b73-b6de-24b6c7b964a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:29:40 devstack sudo[102793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1642b9b1-4d10-44bb-a231-1e4ac636055c_fochbzni
Sep 11 06:29:40 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Acquiring lock "cinder-quobyte-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Lock "cinder-quobyte-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60515ed-e0dc-42e0-8d59-f988843c79f3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:41 devstack sudo[102798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0
Sep 11 06:29:41 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:41 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 1073741824" returned: 0 in 0.537s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:41 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1642b9b1-4d10-44bb-a231-1e4ac636055c_fochbzni" returned: 0 in 0.428s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1642b9b1-4d10-44bb-a231-1e4ac636055c_fochbzni {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:41 devstack sudo[102804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275
Sep 11 06:29:41 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:41 devstack sudo[102803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1642b9b1-4d10-44bb-a231-1e4ac636055c_fochbzni
Sep 11 06:29:41 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:41 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" returned: 0 in 0.513s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:41 devstack sudo[102811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0
Sep 11 06:29:41 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:41 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1642b9b1-4d10-44bb-a231-1e4ac636055c_fochbzni" returned: 1 in 0.410s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1642b9b1-4d10-44bb-a231-1e4ac636055c_fochbzni' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6cd8c1-8134-4dbe-b62e-99167046da6f]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:41 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275" returned: 0 in 0.435s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ceebd-224e-4f31-b73d-44a862d809bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3853e695-dcce-4367-8da8-28dc7d5aa275', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b456481-4637-40cb-a9a3-8c1ddc6a1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:41 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Volume volume-3853e695-dcce-4367-8da8-28dc7d5aa275 (3853e695-dcce-4367-8da8-28dc7d5aa275): created successfully
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b456481-4637-40cb-a9a3-8c1ddc6a1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Flow 'volume_create_manager' (2344af5b-9adf-4738-9d39-c426d287b19c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:29:41 devstack sudo[102815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD
Sep 11 06:29:41 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:41 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d26b6018-5fb6-4fb9-9538-b51b45e8c08d tempest-TestStampPattern-1906228239 None] Created volume successfully.
Sep 11 06:29:41 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" returned: 0 in 0.319s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Lock "cinder-quobyte-0048a9b4-50d1-4b73-b6de-24b6c7b964a0" released by "delete_volume" :: held 0.875s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Created reservations ['f895b168-b306-4221-a7c4-7af022990a91', '97841cf9-116b-4223-b4d5-faf20903f93f', 'bd2c59ed-eea3-492c-a4c0-56197c7ee2db', '84d963a8-a8a7-47f5-bd2d-2fa3e793b0d7'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:42 devstack sudo[102820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:29:42 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:42 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:42 devstack sudo[102822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD
Sep 11 06:29:42 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:42 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.314s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:29:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Deleted volume successfully.
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f10a7d80-80d7-4eac-b828-2b471fb01191 tempest-TestImageHashVerification-1825623558 None] Lock "cinder-0048a9b4-50d1-4b73-b6de-24b6c7b964a0-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:29:42 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD" returned: 1 in 0.445s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] 1642b9b1-4d10-44bb-a231-1e4ac636055c was raw, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:29:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:42 devstack sudo[102829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5
Sep 11 06:29:42 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:43 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5" returned: 0 in 0.587s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1642b9b1-4d10-44bb-a231-1e4ac636055c_9n7h0yp3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:29:43 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:43 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 1G
Sep 11 06:29:43 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:43 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 1G" returned: 0 in 0.557s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Downloaded image 1642b9b1-4d10-44bb-a231-1e4ac636055c ((None, [{'url': 'file:///opt/stack/data/glance/images/1642b9b1-4d10-44bb-a231-1e4ac636055c', 'metadata': {}}])) to volume 967d883f-6cd9-4dc2-9378-374a8aff3da5 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Temporary image 1642b9b1-4d10-44bb-a231-1e4ac636055c for user 46b155530ed44fc89a6d07ca61f8343b is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Marking volume 967d883f-6cd9-4dc2-9378-374a8aff3da5 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Copying metadata from image 1642b9b1-4d10-44bb-a231-1e4ac636055c to 967d883f-6cd9-4dc2-9378-374a8aff3da5. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Creating volume glance metadata for volume 967d883f-6cd9-4dc2-9378-374a8aff3da5 backed by image 1642b9b1-4d10-44bb-a231-1e4ac636055c with: {'image_id': '1642b9b1-4d10-44bb-a231-1e4ac636055c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '03cfbd0edd349fb914cc0bd609f4a343', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def21c46-fb73-4d42-838d-e73bbba26271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967d883f-6cd9-4dc2-9378-374a8aff3da5', 'volume_size': 1, 'image_id': '1642b9b1-4d10-44bb-a231-1e4ac636055c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1642b9b1-4d10-44bb-a231-1e4ac636055c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03cfbd0edd349fb914cc0bd609f4a343', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd603c5686a4464c876909d518b09a15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '297759fe6d68d60eb48c4efcd55a5624b2f55e1169207afbf036416c574988fbf718b8f82b8433965aa1510e7391de96ea18080b034a15de62862ba0a2f69184', 'id': '1642b9b1-4d10-44bb-a231-1e4ac636055c', 'created_at': datetime.datetime(2026, 9, 11, 4, 29, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 29, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1642b9b1-4d10-44bb-a231-1e4ac636055c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316d99820>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2f53f-a06e-4471-bb28-e82f789b52f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:29:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Volume volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 (967d883f-6cd9-4dc2-9378-374a8aff3da5): created successfully
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2f53f-a06e-4471-bb28-e82f789b52f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:29:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Flow 'volume_create_manager' (5728777a-28eb-4314-b0a5-6ed9e76b2bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:29:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e0ea3e2a-018e-46b0-815d-2c6d857e83f5 tempest-VolumeImageDependencyTests-280906143 None] Created volume successfully.
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Acquiring lock "cinder-967d883f-6cd9-4dc2-9378-374a8aff3da5-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Lock "cinder-967d883f-6cd9-4dc2-9378-374a8aff3da5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Acquiring lock "cinder-quobyte-967d883f-6cd9-4dc2-9378-374a8aff3da5" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Lock "cinder-quobyte-967d883f-6cd9-4dc2-9378-374a8aff3da5" acquired by "delete_volume" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d722bc-c832-4edd-a309-900be758f147]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:45 devstack sudo[103287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5
Sep 11 06:29:45 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:45 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5" returned: 0 in 0.495s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:45 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5
Sep 11 06:29:45 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:45 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-967d883f-6cd9-4dc2-9378-374a8aff3da5" returned: 0 in 0.285s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Lock "cinder-quobyte-967d883f-6cd9-4dc2-9378-374a8aff3da5" released by "delete_volume" :: held 0.856s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Created reservations ['ff405c6e-636d-465d-9088-72171c0e9cfd', 'bbcb0bb7-9ecf-48ef-bea1-023baacbd482', '36b82c3b-8ed4-4704-8e70-7ce78c75d5df', '35e1c33e-1630-4073-b213-46053d8ca131'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:46 devstack sudo[103303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:29:46 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:46 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.437s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:29:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Deleted volume successfully.
Sep 11 06:29:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-7fbc72fc-8c30-4f23-bbaf-390de6f7f519 tempest-VolumeImageDependencyTests-280906143 None] Lock "cinder-967d883f-6cd9-4dc2-9378-374a8aff3da5-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:29:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-15cc60a9-b8c5-4291-9768-d8736640758f req-19af8c75-d252-492d-a0c2-1ed59dd3747e tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-15cc60a9-b8c5-4291-9768-d8736640758f req-19af8c75-d252-492d-a0c2-1ed59dd3747e tempest-TestStampPattern-1906228239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-15cc60a9-b8c5-4291-9768-d8736640758f req-19af8c75-d252-492d-a0c2-1ed59dd3747e tempest-TestStampPattern-1906228239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:29:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-15cc60a9-b8c5-4291-9768-d8736640758f req-19af8c75-d252-492d-a0c2-1ed59dd3747e tempest-TestStampPattern-1906228239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-3853e695-dcce-4367-8da8-28dc7d5aa275', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc4641ee-d733-49cc-853e-916935ed5fea', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:29:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-15cc60a9-b8c5-4291-9768-d8736640758f req-19af8c75-d252-492d-a0c2-1ed59dd3747e tempest-TestStampPattern-1906228239 None] attachment_update completed successfully.
Sep 11 06:29:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-ab774476-1821-4f75-a721-dea2f46b3f57 req-88fa5b89-dea3-45c5-a514-4517a43d902d tempest-TestStampPattern-1906228239 None] Terminate volume connection completed successfully.
Sep 11 06:29:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-ab774476-1821-4f75-a721-dea2f46b3f57 req-88fa5b89-dea3-45c5-a514-4517a43d902d tempest-TestStampPattern-1906228239 None] Deleting attachment bc4641ee-d733-49cc-853e-916935ed5fea. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:29:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:29:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:29:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Creating offline snapshot c98d9de9-9344-4db6-ab64-4c32a633dcdc of volume 3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:29:58 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d598026-9d4b-43e6-aa79-2505ce174fc8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:29:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:59 devstack sudo[103363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275
Sep 11 06:29:59 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:29:59 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root
Sep 11 06:29:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275" returned: 0 in 0.464s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:29:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:29:59 devstack sudo[103369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc 1G
Sep 11 06:29:59 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:00 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc 1G" returned: 0 in 0.646s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3853e695-dcce-4367-8da8-28dc7d5aa275 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:00 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3853e695-dcce-4367-8da8-28dc7d5aa275 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc
Sep 11 06:30:00 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (1ae97c5f-0ed0-4a3c-ab86-a2275a173238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee65a4d-1f8f-4c79-a74c-be7e0429ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:00 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3853e695-dcce-4367-8da8-28dc7d5aa275 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc" returned: 0 in 0.484s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:00 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc is being set with open permissions: ugo+rw
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee65a4d-1f8f-4c79-a74c-be7e0429ec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1469779956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0d0642-2d54-4bce-addc-6c84862fc119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:00Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:00 devstack sudo[103380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc
Sep 11 06:30:00 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b15eecb-4b54-456d-82c2-f66422f5d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b15eecb-4b54-456d-82c2-f66422f5d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16d31c2-d561-4e61-96e6-6985a1b26e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16d31c2-d561-4e61-96e6-6985a1b26e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0d0642-2d54-4bce-addc-6c84862fc119', 'volume_name': 'volume-2a0d0642-2d54-4bce-addc-6c84862fc119', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2fdad9-9fe6-4166-a6da-ed30cbd7a4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2fdad9-9fe6-4166-a6da-ed30cbd7a4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635408b7-2bb1-4aa5-b4c3-2686907f50c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:00 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Volume 2a0d0642-2d54-4bce-addc-6c84862fc119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0d0642-2d54-4bce-addc-6c84862fc119', 'volume_size': 1}
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:00 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc" returned: 0 in 0.425s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:01 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.info
Sep 11 06:30:01 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (0ed5fc9b-ecfb-4ee6-b31b-38d5d75412e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7142485-ff64-43b2-9a91-5f1d5c7608d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7142485-ff64-43b2-9a91-5f1d5c7608d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617456548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:01Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebea892a-3ac6-41db-b40d-9cb8353acca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebea892a-3ac6-41db-b40d-9cb8353acca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74255cf-371d-4cab-acf9-e2104d55336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74255cf-371d-4cab-acf9-e2104d55336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba', 'volume_name': 'volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c187d0b2-f31d-4430-adb0-07d5050c8b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c187d0b2-f31d-4430-adb0-07d5050c8b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72257c4-f701-4ba0-844b-8edecccde215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Volume 9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba', 'volume_size': 1}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:01 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.info" returned: 0 in 0.394s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:01 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.info is being set with open permissions: ugo+rw
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:01 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.info
Sep 11 06:30:01 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (179ce01c-d013-4fdc-8981-399887f84660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b212d8d3-7661-4781-9570-3d7b9930cec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b212d8d3-7661-4781-9570-3d7b9930cec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249175473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6a9609-6305-42f7-85ed-8947e3b75c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:02Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1afe815-ae67-4ec0-aef4-16c9e85f4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1afe815-ae67-4ec0-aef4-16c9e85f4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29c2351-30d1-4513-aa1a-c3d6f6b7c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29c2351-30d1-4513-aa1a-c3d6f6b7c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6a9609-6305-42f7-85ed-8947e3b75c38', 'volume_name': 'volume-be6a9609-6305-42f7-85ed-8947e3b75c38', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6d68a1-49fe-4a50-8cc6-28062ca6b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6d68a1-49fe-4a50-8cc6-28062ca6b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4327782a-124e-4336-9efc-8c88bd7f4b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:01 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Volume be6a9609-6305-42f7-85ed-8947e3b75c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6a9609-6305-42f7-85ed-8947e3b75c38', 'volume_size': 1}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:01 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.info" returned: 0 in 0.463s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.050s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.208s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1469779956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0d0642-2d54-4bce-addc-6c84862fc119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:00Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Creating volume 2a0d0642-2d54-4bce-addc-6c84862fc119 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:01 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:02 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119 1073741824
Sep 11 06:30:02 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d797532b-62a3-43ea-9f3d-9f50fe96c263 tempest-TestStampPattern-1906228239 None] Create snapshot completed successfully
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (991b21c2-f7ca-465d-835d-c1e3954bb7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a41d374-c26f-455a-b863-599d08aeea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a41d374-c26f-455a-b863-599d08aeea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147722378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87ad878-4c9e-4114-8669-eea8d41fd245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:02Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bc7f8e-3556-4c89-af15-45e3858ec869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bc7f8e-3556-4c89-af15-45e3858ec869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46380cf-eb1a-4ab5-9449-37ac5f0083c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46380cf-eb1a-4ab5-9449-37ac5f0083c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87ad878-4c9e-4114-8669-eea8d41fd245', 'volume_name': 'volume-e87ad878-4c9e-4114-8669-eea8d41fd245', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c466a3e6-fabc-4b7f-a410-34356d3b16f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c466a3e6-fabc-4b7f-a410-34356d3b16f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3a5aaa-c564-454f-8656-7b56ee2ee143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:02 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Volume e87ad878-4c9e-4114-8669-eea8d41fd245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87ad878-4c9e-4114-8669-eea8d41fd245', 'volume_size': 1}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:02 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119 1073741824" returned: 0 in 0.790s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:02 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119
Sep 11 06:30:02 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (d4c25726-fce7-4f7d-a63c-dcbd22ba3d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2945c021-1a1c-41c4-91ae-2f25411d484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2945c021-1a1c-41c4-91ae-2f25411d484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17421471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8166698c-be4a-4380-88f4-65944b3ab718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:03Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd905cc-b6f8-48d4-8eb1-3d89f0de00c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd905cc-b6f8-48d4-8eb1-3d89f0de00c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e2a563-ee29-4efa-91f1-1690689012a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e2a563-ee29-4efa-91f1-1690689012a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8166698c-be4a-4380-88f4-65944b3ab718', 'volume_name': 'volume-8166698c-be4a-4380-88f4-65944b3ab718', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed9bf13-dd28-4193-a032-e5d2390e6fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed9bf13-dd28-4193-a032-e5d2390e6fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e17897-215d-42bc-8f48-927ff94d615d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Volume 8166698c-be4a-4380-88f4-65944b3ab718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8166698c-be4a-4380-88f4-65944b3ab718', 'volume_size': 1}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:03 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119" returned: 0 in 0.367s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617456548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:01Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Creating volume 9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:03 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635408b7-2bb1-4aa5-b4c3-2686907f50c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0d0642-2d54-4bce-addc-6c84862fc119', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eed05ea-675a-459d-860f-ed9b64ed1053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:03 devstack sudo[103408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba 1073741824
Sep 11 06:30:03 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Volume volume-2a0d0642-2d54-4bce-addc-6c84862fc119 (2a0d0642-2d54-4bce-addc-6c84862fc119): created successfully
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eed05ea-675a-459d-860f-ed9b64ed1053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (1ae97c5f-0ed0-4a3c-ab86-a2275a173238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9533c5a8-cbcb-43ca-97a0-eb8f4420be12 tempest-CreateVolumesFromImageTest-1745363796 None] Created volume successfully.
Sep 11 06:30:03 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba 1073741824" returned: 0 in 0.597s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:03 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba
Sep 11 06:30:03 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:04 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba" returned: 0 in 0.333s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.374s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249175473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6a9609-6305-42f7-85ed-8947e3b75c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:02Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Creating volume be6a9609-6305-42f7-85ed-8947e3b75c38 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:04 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72257c4-f701-4ba0-844b-8edecccde215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d1813b-b701-42ab-84dc-904b822a7e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:04 devstack sudo[103442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38 1073741824
Sep 11 06:30:04 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Volume volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba (9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba): created successfully
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d1813b-b701-42ab-84dc-904b822a7e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (0ed5fc9b-ecfb-4ee6-b31b-38d5d75412e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a205143b-21cd-4074-bcbd-95f9423bb153 tempest-CreateVolumesFromImageTest-1745363796 None] Created volume successfully.
Sep 11 06:30:04 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38 1073741824" returned: 0 in 0.477s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:04 devstack sudo[103454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38
Sep 11 06:30:04 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:05 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38" returned: 0 in 0.338s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.445s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147722378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87ad878-4c9e-4114-8669-eea8d41fd245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:02Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Creating volume e87ad878-4c9e-4114-8669-eea8d41fd245 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:05 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4327782a-124e-4336-9efc-8c88bd7f4b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6a9609-6305-42f7-85ed-8947e3b75c38', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:05 devstack sudo[103475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245 1073741824
Sep 11 06:30:05 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305ec912-dc41-46ad-9afb-f2c46e3c7d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:05 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Volume volume-be6a9609-6305-42f7-85ed-8947e3b75c38 (be6a9609-6305-42f7-85ed-8947e3b75c38): created successfully
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305ec912-dc41-46ad-9afb-f2c46e3c7d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (179ce01c-d013-4fdc-8981-399887f84660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-345c664d-71d6-4b37-91d9-be86354596d1 tempest-CreateVolumesFromImageTest-1745363796 None] Created volume successfully.
Sep 11 06:30:05 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245 1073741824" returned: 0 in 0.428s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:05 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245
Sep 11 06:30:05 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:05 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245" returned: 0 in 0.271s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17421471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8166698c-be4a-4380-88f4-65944b3ab718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc33ce9c6364dcfb130c4de54824f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:03Z,use_quota=True,user_id='4ac31ea79a6947db8b4c4075c38426af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Creating volume 8166698c-be4a-4380-88f4-65944b3ab718 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:05 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3a5aaa-c564-454f-8656-7b56ee2ee143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87ad878-4c9e-4114-8669-eea8d41fd245', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e396177-f123-408f-bbdb-b78127833937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:05 devstack sudo[103493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718 1073741824
Sep 11 06:30:05 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:05 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Volume volume-e87ad878-4c9e-4114-8669-eea8d41fd245 (e87ad878-4c9e-4114-8669-eea8d41fd245): created successfully
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e396177-f123-408f-bbdb-b78127833937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (991b21c2-f7ca-465d-835d-c1e3954bb7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c71d6d32-5d06-4310-94ba-b72a8ee7f318 tempest-CreateVolumesFromImageTest-1745363796 None] Created volume successfully.
Sep 11 06:30:06 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718 1073741824" returned: 0 in 0.499s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:06 devstack sudo[103499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718
Sep 11 06:30:06 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:06 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718" returned: 0 in 0.281s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e17897-215d-42bc-8f48-927ff94d615d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8166698c-be4a-4380-88f4-65944b3ab718', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d62bc7-a044-4839-9209-3fabc81173af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:06 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Volume volume-8166698c-be4a-4380-88f4-65944b3ab718 (8166698c-be4a-4380-88f4-65944b3ab718): created successfully
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d62bc7-a044-4839-9209-3fabc81173af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Flow 'volume_create_manager' (d4c25726-fce7-4f7d-a63c-dcbd22ba3d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-57e4a57d-c75d-44fe-a32b-32271e372c90 tempest-CreateVolumesFromImageTest-1745363796 None] Created volume successfully.
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-8166698c-be4a-4380-88f4-65944b3ab718-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-8166698c-be4a-4380-88f4-65944b3ab718-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-quobyte-8166698c-be4a-4380-88f4-65944b3ab718" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-8166698c-be4a-4380-88f4-65944b3ab718" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8121b86-6cc7-4e0a-a3dc-5f04d4a2a6a6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:07 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718
Sep 11 06:30:07 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:07 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718" returned: 0 in 0.394s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:08 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718
Sep 11 06:30:08 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:08 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8166698c-be4a-4380-88f4-65944b3ab718" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-8166698c-be4a-4380-88f4-65944b3ab718" released by "delete_volume" :: held 0.700s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Created reservations ['20067130-c9e5-4b1b-8c97-0e08ff97a3cb', 'b1609531-5d47-4ea8-a0e5-a644b3706063', '62a6ba71-6cf8-4eca-aaf5-96c543a2e370', '79c9a4d4-1b10-478a-bcb2-1a0c6ac33f4e'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:08 devstack sudo[103511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:08 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-e87ad878-4c9e-4114-8669-eea8d41fd245-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-e87ad878-4c9e-4114-8669-eea8d41fd245-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:08 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.320s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Deleted volume successfully.
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-quobyte-e87ad878-4c9e-4114-8669-eea8d41fd245" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aedd5a88-fc22-4b47-816b-11e4a642c384 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-8166698c-be4a-4380-88f4-65944b3ab718-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-e87ad878-4c9e-4114-8669-eea8d41fd245" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1f18d9-1612-40ff-9ec5-34a4d0690772]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:08 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245
Sep 11 06:30:08 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:09 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245" returned: 0 in 0.441s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:09 devstack sudo[103519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245
Sep 11 06:30:09 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:09 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e87ad878-4c9e-4114-8669-eea8d41fd245" returned: 0 in 0.290s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-e87ad878-4c9e-4114-8669-eea8d41fd245" released by "delete_volume" :: held 0.797s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Created reservations ['9da1c4bc-d43a-48fb-b31c-ebfdca1f471e', '348e59f3-8386-4ff5-92a2-22dc294d5bb8', '62679225-89d3-4d3e-b3a5-c6a06b2e356c', '52ad05d7-cd08-48e4-a8d1-5e72dd812318'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Flow 'volume_create_manager' (e330218a-e7af-4ea1-b44c-7534d920082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231aaee4-8174-4247-8dbd-8c47aedd910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:09 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:09 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231aaee4-8174-4247-8dbd-8c47aedd910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2099363288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b543f2-8b63-4995-aaed-19f1b27a79b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040e03b2b7db4a48a1c9738a1e405968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c98d9de9-9344-4db6-ab64-4c32a633dcdc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:10Z,use_quota=True,user_id='bebd185b72104d60a2399ca4efa1dcd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45efc68d-11d2-44b4-84c4-a7b48b4d3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45efc68d-11d2-44b4-84c4-a7b48b4d3064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2145557-d0d4-448a-9fce-5a33faa51dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2145557-d0d4-448a-9fce-5a33faa51dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0b543f2-8b63-4995-aaed-19f1b27a79b1', 'volume_name': 'volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1', 'volume_size': 1, 'snapshot_id': 'c98d9de9-9344-4db6-ab64-4c32a633dcdc'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49af191-8803-4015-9362-195eb561d977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49af191-8803-4015-9362-195eb561d977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dddbf66-d760-4a8c-9ad5-5cfde02c1430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:09 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Volume b0b543f2-8b63-4995-aaed-19f1b27a79b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1', 'volume_size': 1, 'snapshot_id': 'c98d9de9-9344-4db6-ab64-4c32a633dcdc'}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-quobyte-c98d9de9-9344-4db6-ab64-4c32a633dcdc-b0b543f2-8b63-4995-aaed-19f1b27a79b1" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-c98d9de9-9344-4db6-ab64-4c32a633dcdc-b0b543f2-8b63-4995-aaed-19f1b27a79b1" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Creating volume b0b543f2-8b63-4995-aaed-19f1b27a79b1 from snapshot c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-quobyte-b0b543f2-8b63-4995-aaed-19f1b27a79b1" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-be6a9609-6305-42f7-85ed-8947e3b75c38-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-b0b543f2-8b63-4995-aaed-19f1b27a79b1" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] snapshot: c98d9de9-9344-4db6-ab64-4c32a633dcdc, volume: b0b543f2-8b63-4995-aaed-19f1b27a79b1,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-be6a9609-6305-42f7-85ed-8947e3b75c38-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f285b2-99b8-4506-b419-85e69c40bddf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-quobyte-be6a9609-6305-42f7-85ed-8947e3b75c38" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-be6a9609-6305-42f7-85ed-8947e3b75c38" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3106d8b-7c93-4991-a45a-64726e348ff7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:10 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.404s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Deleted volume successfully.
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a279eb7c-b1c6-46cd-9430-52316b11b397 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-e87ad878-4c9e-4114-8669-eea8d41fd245-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:10 devstack sudo[103524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc
Sep 11 06:30:10 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:10 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38
Sep 11 06:30:10 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:10 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc" returned: 0 in 0.427s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3853e695-dcce-4367-8da8-28dc7d5aa275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d23e48b-049e-400b-b17f-e73c4089e25d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:10 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38" returned: 0 in 0.440s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:10 devstack sudo[103540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38
Sep 11 06:30:10 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:10 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275
Sep 11 06:30:10 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:10 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-be6a9609-6305-42f7-85ed-8947e3b75c38" returned: 0 in 0.273s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-be6a9609-6305-42f7-85ed-8947e3b75c38" released by "delete_volume" :: held 0.760s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Created reservations ['e4c61fd1-cc37-4f22-bde6-655e4d370546', '0eb2a21f-1a45-4603-a4f8-7dd50464e11c', '6c1fd939-bd06-48fd-84d6-9887a2402239', 'f7119eba-b827-481d-b57a-1ef86b58d30e'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:11 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275" returned: 0 in 0.447s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:11 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1
Sep 11 06:30:11 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:11 devstack sudo[103549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:11 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-quobyte-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb968b24-a8d2-4ef7-a5d1-889bfd7c2732]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:11 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.319s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Deleted volume successfully.
Sep 11 06:30:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-798628a4-3186-40c6-a7b4-31f7b574f796 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-be6a9609-6305-42f7-85ed-8947e3b75c38-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:11 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba
Sep 11 06:30:11 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:12 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba" returned: 0 in 0.609s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:12 devstack sudo[103567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba
Sep 11 06:30:12 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:12 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba" returned: 0 in 0.552s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba" released by "delete_volume" :: held 1.245s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:12 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Created reservations ['24a2a51e-428d-4c79-9968-38da505c7762', '97f43030-e5e6-4ba2-8d47-9803aa9b5b52', '5e898dca-e8f1-485e-b633-4019d6bb02a4', 'a7f34c2a-99fd-439a-9e72-bc107ed4cea2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:13 devstack sudo[103570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:13 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:13 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.570s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Deleted volume successfully.
Sep 11 06:30:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e9ef202f-db84-40d2-93b2-e5b6d0a99582 tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-9a1ccf39-68c1-4eb2-bc31-12aae8fd33ba-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-2a0d0642-2d54-4bce-addc-6c84862fc119-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-2a0d0642-2d54-4bce-addc-6c84862fc119-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "cinder-quobyte-2a0d0642-2d54-4bce-addc-6c84862fc119" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-2a0d0642-2d54-4bce-addc-6c84862fc119" acquired by "delete_volume" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[212d3507-187e-4583-a7e3-d56fc2a3dd11]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:14 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119
Sep 11 06:30:14 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:15 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119" returned: 0 in 1.058s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:15 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119
Sep 11 06:30:15 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:16 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2a0d0642-2d54-4bce-addc-6c84862fc119" returned: 0 in 0.640s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-quobyte-2a0d0642-2d54-4bce-addc-6c84862fc119" released by "delete_volume" :: held 1.818s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Created reservations ['f39b52e6-b610-4d81-8db4-c12e1a6506f1', 'b7c7c79c-eae7-4726-b1d5-de232cf62c68', '618bf9f3-f006-4ec0-aa29-1c8a508aa296', '0fa5da35-8da6-41d3-a049-ba1aec6c1bf2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:16 devstack sudo[103585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:16 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:17 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.647s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Deleted volume successfully.
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-940b8224-f5bd-4b8c-9374-1990db52ae9e tempest-CreateVolumesFromImageTest-1745363796 None] Lock "cinder-2a0d0642-2d54-4bce-addc-6c84862fc119-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:17 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1" returned: 0 in 6.634s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:30:17 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Converted 1024.00 MB image at 154.32 MB/s
Sep 11 06:30:17 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 is being set with open permissions: ugo+rw
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:17 devstack sudo[103602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1
Sep 11 06:30:17 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:17 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1" returned: 0 in 0.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-b0b543f2-8b63-4995-aaed-19f1b27a79b1" released by "_copy_volume_from_snapshot" :: held 7.934s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-c98d9de9-9344-4db6-ab64-4c32a633dcdc-b0b543f2-8b63-4995-aaed-19f1b27a79b1" released by "_create_volume_from_snapshot" :: held 8.047s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.080s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dddbf66-d760-4a8c-9ad5-5cfde02c1430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1', 'volume_size': 1, 'snapshot_id': 'c98d9de9-9344-4db6-ab64-4c32a633dcdc'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ad9a99-08f2-445c-a474-4e787cf12250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:18 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Volume volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 (b0b543f2-8b63-4995-aaed-19f1b27a79b1): created successfully
Sep 11 06:30:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ad9a99-08f2-445c-a474-4e787cf12250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Flow 'volume_create_manager' (e330218a-e7af-4ea1-b44c-7534d920082c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fc8ba638-b8e0-4fd4-bf7a-570c011102ab tempest-TestStampPattern-1906228239 None] Created volume successfully.
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Flow 'volume_create_manager' (228d0611-b164-44a4-8c80-a8d753119d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb2d5d5-1e54-4c7a-90fc-9949a2df1c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb2d5d5-1e54-4c7a-90fc-9949a2df1c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-879135366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5aaf46-71ba-4480-9717-446c4b2f89f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ce62b1a264db1864eda096a3d66c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:21Z,use_quota=True,user_id='954d585ef5934f178471445eff3ee4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fe137d-535d-4619-b63d-393f6eabe8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fe137d-535d-4619-b63d-393f6eabe8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f2e298-c9fc-490b-9734-c43675b99d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f2e298-c9fc-490b-9734-c43675b99d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5aaf46-71ba-4480-9717-446c4b2f89f0', 'volume_name': 'volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a048ca-09d8-4493-887e-ee4894798556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a048ca-09d8-4493-887e-ee4894798556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b909c-78a6-4636-a3fa-b8481406a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:20 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Volume dc5aaf46-71ba-4480-9717-446c4b2f89f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0', 'volume_size': 1}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-879135366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5aaf46-71ba-4480-9717-446c4b2f89f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ce62b1a264db1864eda096a3d66c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:21Z,use_quota=True,user_id='954d585ef5934f178471445eff3ee4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Creating volume dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:20 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:20 devstack sudo[103661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 1073741824
Sep 11 06:30:20 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:21 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 1073741824" returned: 0 in 0.483s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:21 devstack sudo[103666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0
Sep 11 06:30:21 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:21 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0" returned: 0 in 0.279s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b909c-78a6-4636-a3fa-b8481406a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687bb88a-7a84-4bb9-9a07-4fed677de138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:21 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Volume volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 (dc5aaf46-71ba-4480-9717-446c4b2f89f0): created successfully
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687bb88a-7a84-4bb9-9a07-4fed677de138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Flow 'volume_create_manager' (228d0611-b164-44a4-8c80-a8d753119d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2beef254-6223-4b27-ac55-a1a8726da35b tempest-VolumeDependencyTests-416744265 None] Created volume successfully.
Sep 11 06:30:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:23 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Creating offline snapshot 63db2758-5c90-4fec-8eb3-6105bdfc99b1 of volume dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:30:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e26e49d-68fe-4ef8-a8e6-9cd556c05c5b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:23 devstack sudo[103669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0
Sep 11 06:30:23 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:23 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0" returned: 0 in 0.453s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:23 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 1G
Sep 11 06:30:23 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:24 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 1G" returned: 0 in 0.451s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:24 devstack sudo[103681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1
Sep 11 06:30:24 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:24 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1" returned: 0 in 0.307s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:24 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 is being set with open permissions: ugo+rw
Sep 11 06:30:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:24 devstack sudo[103686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1
Sep 11 06:30:24 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:24 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1" returned: 0 in 0.254s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:24 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.info
Sep 11 06:30:24 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:25 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.info" returned: 0 in 0.254s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:25 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.info is being set with open permissions: ugo+rw
Sep 11 06:30:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:25 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.info
Sep 11 06:30:25 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:25 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.info" returned: 0 in 0.260s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c97d9a5d-457b-479b-bb5a-2802c8d750ff tempest-VolumeDependencyTests-416744265 None] Create snapshot completed successfully
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Flow 'volume_create_manager' (23a81ccb-79a2-4004-8949-d46a19aaa979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b104816f-6e51-4129-865c-c5032815eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b104816f-6e51-4129-865c-c5032815eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1390680148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a931cb-7b40-4830-8d78-5617aaec94f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64ce62b1a264db1864eda096a3d66c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63db2758-5c90-4fec-8eb3-6105bdfc99b1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:27Z,use_quota=True,user_id='954d585ef5934f178471445eff3ee4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c10284e-27de-4772-a91c-96b450def49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c10284e-27de-4772-a91c-96b450def49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcaf1a0-2e89-47c6-ae54-73c3babe9c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcaf1a0-2e89-47c6-ae54-73c3babe9c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40a931cb-7b40-4830-8d78-5617aaec94f8', 'volume_name': 'volume-40a931cb-7b40-4830-8d78-5617aaec94f8', 'volume_size': 1, 'snapshot_id': '63db2758-5c90-4fec-8eb3-6105bdfc99b1'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b380c1-36dc-4e0a-b495-86f772888505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b380c1-36dc-4e0a-b495-86f772888505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70948a8a-4e04-4173-af21-ff485ac809b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:27 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Volume 40a931cb-7b40-4830-8d78-5617aaec94f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40a931cb-7b40-4830-8d78-5617aaec94f8', 'volume_size': 1, 'snapshot_id': '63db2758-5c90-4fec-8eb3-6105bdfc99b1'}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-quobyte-63db2758-5c90-4fec-8eb3-6105bdfc99b1-40a931cb-7b40-4830-8d78-5617aaec94f8" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-63db2758-5c90-4fec-8eb3-6105bdfc99b1-40a931cb-7b40-4830-8d78-5617aaec94f8" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Creating volume 40a931cb-7b40-4830-8d78-5617aaec94f8 from snapshot 63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-quobyte-40a931cb-7b40-4830-8d78-5617aaec94f8" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-40a931cb-7b40-4830-8d78-5617aaec94f8" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] snapshot: 63db2758-5c90-4fec-8eb3-6105bdfc99b1, volume: 40a931cb-7b40-4830-8d78-5617aaec94f8,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:27 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-74ade9d0-0688-481f-afc3-00116a46b481 tempest-TestShelveInstance-62893784 None] Terminate volume connection completed successfully.
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-74ade9d0-0688-481f-afc3-00116a46b481 tempest-TestShelveInstance-62893784 None] Deleting attachment 240392bb-c07d-43bd-9953-7019e33ae2c5. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78d025d-68ba-4859-97fb-778adc987ca9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:27 devstack sudo[103724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1
Sep 11 06:30:27 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Acquiring lock "cinder-65bb9061-357f-4901-8343-bf8f4c105f69-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Lock "cinder-65bb9061-357f-4901-8343-bf8f4c105f69-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Acquiring lock "cinder-quobyte-65bb9061-357f-4901-8343-bf8f4c105f69" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Lock "cinder-quobyte-65bb9061-357f-4901-8343-bf8f4c105f69" acquired by "delete_volume" :: waited 0.044s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a40551-54b7-4219-b1dd-44d97c5210e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:28 devstack sudo[103726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69
Sep 11 06:30:28 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:28 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1" returned: 0 in 0.615s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d8521a-81b8-4978-8ecf-1aa247e67c1b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:28 devstack sudo[103736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0
Sep 11 06:30:28 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:28 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69" returned: 0 in 0.557s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:28 devstack sudo[103741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69
Sep 11 06:30:28 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:28 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0" returned: 0 in 0.499s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:28 devstack sudo[103747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8
Sep 11 06:30:28 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:28 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-65bb9061-357f-4901-8343-bf8f4c105f69" returned: 0 in 0.265s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Lock "cinder-quobyte-65bb9061-357f-4901-8343-bf8f4c105f69" released by "delete_volume" :: held 0.905s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG cinder.quota [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Created reservations ['e3f81f54-3cc2-44de-85e3-e6f9906fe3b4', '8c9725b8-852c-4928-b531-b8f8f93b00a6', '421e30c1-47e4-4366-9eb2-8fe12f70b93f', '7240f97c-6a7a-417b-a8ef-bd06bb077bb2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:29 devstack sudo[103752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:29 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:29 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.366s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG cinder.manager [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Deleted volume successfully.
Sep 11 06:30:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [req-f3418550-5cae-4dbe-b580-d5e2bfb8b9aa req-d6c20551-b654-416f-9592-55cce96dd2c4 tempest-TestShelveInstance-62893784 None] Lock "cinder-65bb9061-357f-4901-8343-bf8f4c105f69-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:30:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:31 devstack sudo[103765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:31 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:32 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.943s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:32 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:32 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:30:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:30:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:30:34 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8" returned: 0 in 6.054s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:34 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:30:34 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Converted 1024.00 MB image at 169.11 MB/s
Sep 11 06:30:34 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8 is being set with open permissions: ugo+rw
Sep 11 06:30:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:34 devstack sudo[103813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8
Sep 11 06:30:34 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:35 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8" returned: 0 in 0.270s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-40a931cb-7b40-4830-8d78-5617aaec94f8" released by "_copy_volume_from_snapshot" :: held 7.529s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-63db2758-5c90-4fec-8eb3-6105bdfc99b1-40a931cb-7b40-4830-8d78-5617aaec94f8" released by "_create_volume_from_snapshot" :: held 7.609s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.640s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70948a8a-4e04-4173-af21-ff485ac809b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a931cb-7b40-4830-8d78-5617aaec94f8', 'volume_size': 1, 'snapshot_id': '63db2758-5c90-4fec-8eb3-6105bdfc99b1'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b2cae6-758d-4132-a4c2-2566a8e04a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:35 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Volume volume-40a931cb-7b40-4830-8d78-5617aaec94f8 (40a931cb-7b40-4830-8d78-5617aaec94f8): created successfully
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b2cae6-758d-4132-a4c2-2566a8e04a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Flow 'volume_create_manager' (23a81ccb-79a2-4004-8949-d46a19aaa979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d9975bf6-a7e7-4aba-a679-d83e42c004c6 tempest-VolumeDependencyTests-416744265 None] Created volume successfully.
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-63db2758-5c90-4fec-8eb3-6105bdfc99b1-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-63db2758-5c90-4fec-8eb3-6105bdfc99b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-quobyte-dc5aaf46-71ba-4480-9717-446c4b2f89f0" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-dc5aaf46-71ba-4480-9717-446c4b2f89f0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-quobyte-63db2758-5c90-4fec-8eb3-6105bdfc99b1" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-63db2758-5c90-4fec-8eb3-6105bdfc99b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Deleting offline snapshot 63db2758-5c90-4fec-8eb3-6105bdfc99b1 of volume dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] snapshot_file for this snap is: volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae57cbd-e586-47bd-90ec-3c0ccffbaae9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:35 devstack sudo[103817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1
Sep 11 06:30:35 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:35 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1" returned: 0 in 0.366s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:30:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c28889d-38f6-4088-886f-4bbb676132ca]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:36 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0
Sep 11 06:30:36 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:36 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0" returned: 0 in 0.518s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:36 devstack sudo[103827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1
Sep 11 06:30:36 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:36 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1" returned: 0 in 0.366s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:36 devstack sudo[103832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1
Sep 11 06:30:36 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:37 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0.63db2758-5c90-4fec-8eb3-6105bdfc99b1" returned: 0 in 0.250s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-63db2758-5c90-4fec-8eb3-6105bdfc99b1" released by "_delete_snapshot" :: held 1.597s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-dc5aaf46-71ba-4480-9717-446c4b2f89f0" released by "delete_snapshot" :: held 1.617s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Created reservations ['7be3bd2e-e745-4a18-ba9c-e7cc80d04d7c', 'abfa6486-cabd-4b2f-b2f5-e31b6152b2b7', '7fa89bad-fa77-461f-968a-34d19827b766', '66d14ce8-47b9-4ea5-b1ce-c0692020bc93'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Delete snapshot completed successfully.
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-25380c81-5b69-47e6-ba14-933f27d2c723 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-63db2758-5c90-4fec-8eb3-6105bdfc99b1-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-dc5aaf46-71ba-4480-9717-446c4b2f89f0-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Lock "cinder-dc5aaf46-71ba-4480-9717-446c4b2f89f0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=95,cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=10 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=92,cinder:UPDATE=101,cinder:INSERT=30,cinder:DELETE=10 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-quobyte-dc5aaf46-71ba-4480-9717-446c4b2f89f0" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-dc5aaf46-71ba-4480-9717-446c4b2f89f0" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b7d8f6-a00e-44ae-bd03-6b5ef9f379f9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:37 devstack sudo[103835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0
Sep 11 06:30:37 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:38 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0" returned: 0 in 0.413s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:38 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0
Sep 11 06:30:38 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:38 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-dc5aaf46-71ba-4480-9717-446c4b2f89f0" returned: 0 in 0.261s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-dc5aaf46-71ba-4480-9717-446c4b2f89f0" released by "delete_volume" :: held 0.749s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Created reservations ['9f663947-8727-40bd-936b-0a60d49436f8', '14fd2861-1475-484b-83e1-29ccdb8396a9', 'ac50403f-fbbf-458a-84db-e6be0ed794a2', 'f607c827-2b23-48c8-9020-81c0c6edb666'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:38 devstack sudo[103845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:38 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-40a931cb-7b40-4830-8d78-5617aaec94f8-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:38 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.272s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:38 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Deleted volume successfully.
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-40a931cb-7b40-4830-8d78-5617aaec94f8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48facfdf-e61a-4396-8edd-07bc5768fb1d tempest-VolumeDependencyTests-416744265 None] Lock "cinder-dc5aaf46-71ba-4480-9717-446c4b2f89f0-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "cinder-quobyte-40a931cb-7b40-4830-8d78-5617aaec94f8" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-40a931cb-7b40-4830-8d78-5617aaec94f8" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf92a701-2830-497d-aa22-b06d625e070d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:39 devstack sudo[103848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8
Sep 11 06:30:39 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:39 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8" returned: 0 in 0.389s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:39 devstack sudo[103854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8
Sep 11 06:30:39 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:39 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-40a931cb-7b40-4830-8d78-5617aaec94f8" returned: 0 in 0.251s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-quobyte-40a931cb-7b40-4830-8d78-5617aaec94f8" released by "delete_volume" :: held 0.686s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Created reservations ['a6c840c1-2bc6-4bd5-bec3-0e04ca46a69a', 'bb13e96c-2999-4a26-bdb7-32568433d665', 'de422c1e-9888-4fad-93d7-262bc89e3aa9', '9a2c3bf1-cdf6-4807-ae04-b345d89187ba'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:39 devstack sudo[103857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:39 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:40 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.282s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:40 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Deleted volume successfully.
Sep 11 06:30:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e87423bf-eafb-422d-8c38-bce2e51cadb0 tempest-VolumeDependencyTests-416744265 None] Lock "cinder-40a931cb-7b40-4830-8d78-5617aaec94f8-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (dfeca3e5-154d-4951-99ed-6227f4941b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c34723d-f15a-4861-b111-51d68ba30f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c34723d-f15a-4861-b111-51d68ba30f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480785189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09fde00-1588-4a6d-9c4c-70075e7cb3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:44Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cf10fe-a55b-4412-9179-9ba656ef4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2cf10fe-a55b-4412-9179-9ba656ef4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07eb179-8682-4fa1-a923-9c4a3c1123b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07eb179-8682-4fa1-a923-9c4a3c1123b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09fde00-1588-4a6d-9c4c-70075e7cb3a2', 'volume_name': 'volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7152e76a-2d11-41c4-9098-fb90b43538bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7152e76a-2d11-41c4-9098-fb90b43538bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb1dd83-89d6-47bd-9c1c-e40c84b06cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:44 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Volume f09fde00-1588-4a6d-9c4c-70075e7cb3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2', 'volume_size': 1}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480785189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09fde00-1588-4a6d-9c4c-70075e7cb3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:44Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Creating volume f09fde00-1588-4a6d-9c4c-70075e7cb3a2 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:44 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:44 devstack sudo[103862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2 1073741824
Sep 11 06:30:44 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:44 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2 1073741824" returned: 0 in 0.503s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:44 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2
Sep 11 06:30:44 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:45 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2" returned: 0 in 0.386s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb1dd83-89d6-47bd-9c1c-e40c84b06cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b97f7a-06fd-401f-8161-0ac7c408b059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Volume volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2 (f09fde00-1588-4a6d-9c4c-70075e7cb3a2): created successfully
Sep 11 06:30:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b97f7a-06fd-401f-8161-0ac7c408b059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (dfeca3e5-154d-4951-99ed-6227f4941b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-39d6385d-147c-49c2-a7c6-044294d42fe3 tempest-ProjectReaderTests-1288671137 None] Created volume successfully.
Sep 11 06:30:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-f09fde00-1588-4a6d-9c4c-70075e7cb3a2-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Lock "cinder-f09fde00-1588-4a6d-9c4c-70075e7cb3a2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-quobyte-f09fde00-1588-4a6d-9c4c-70075e7cb3a2" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-f09fde00-1588-4a6d-9c4c-70075e7cb3a2" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:46 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa271029-8b2b-4122-9033-b41e14edc91d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:46 devstack sudo[103877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2
Sep 11 06:30:46 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:47 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2" returned: 0 in 0.371s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:47 devstack sudo[103882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2
Sep 11 06:30:47 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:47 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f09fde00-1588-4a6d-9c4c-70075e7cb3a2" returned: 0 in 0.248s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-f09fde00-1588-4a6d-9c4c-70075e7cb3a2" released by "delete_volume" :: held 0.668s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Created reservations ['b3afad56-8de3-4840-921e-06ce168e2366', '1d75bc44-6acc-4cf0-a3cf-6c92480a410e', '2b81b9dc-ec19-4493-b81f-7c9a8e1afb01', '4c68bdd1-f440-40ef-8685-21f7f8c9956d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:47 devstack sudo[103885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:47 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:47 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.262s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Deleted volume successfully.
Sep 11 06:30:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6b142c1c-dd55-4404-9aa6-c343a4cac77c tempest-ProjectReaderTests-1288671137 None] Lock "cinder-f09fde00-1588-4a6d-9c4c-70075e7cb3a2-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (a2610b18-c177-4fba-8fa7-c84a247e1fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cda9f2-e215-4cd2-a925-56ae42a7559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cda9f2-e215-4cd2-a925-56ae42a7559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329677795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de414d41-343a-4c64-9c6a-09525460685c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:48Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb78d458-4efe-43f7-b9d9-50de9f07e861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb78d458-4efe-43f7-b9d9-50de9f07e861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaf0bf9-5a78-4043-8a2c-85ae372476c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdaf0bf9-5a78-4043-8a2c-85ae372476c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de414d41-343a-4c64-9c6a-09525460685c', 'volume_name': 'volume-de414d41-343a-4c64-9c6a-09525460685c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ce384c-8b50-4452-a284-3bed06ad46b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ce384c-8b50-4452-a284-3bed06ad46b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8329a41f-eb4e-4bf1-973b-38ec1a745d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:48 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Volume de414d41-343a-4c64-9c6a-09525460685c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de414d41-343a-4c64-9c6a-09525460685c', 'volume_size': 1}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329677795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de414d41-343a-4c64-9c6a-09525460685c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:48Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Creating volume de414d41-343a-4c64-9c6a-09525460685c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:48 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:48 devstack sudo[103889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c 1073741824
Sep 11 06:30:48 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:48 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c 1073741824" returned: 0 in 0.433s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:48 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c
Sep 11 06:30:48 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:49 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c" returned: 0 in 0.257s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8329a41f-eb4e-4bf1-973b-38ec1a745d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de414d41-343a-4c64-9c6a-09525460685c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0623e429-7b8b-4f8e-ac94-a1210ebb4a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Volume volume-de414d41-343a-4c64-9c6a-09525460685c (de414d41-343a-4c64-9c6a-09525460685c): created successfully
Sep 11 06:30:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0623e429-7b8b-4f8e-ac94-a1210ebb4a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (a2610b18-c177-4fba-8fa7-c84a247e1fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:49 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ae8a8558-279e-4dc9-92da-dfe004ecd72e tempest-ProjectReaderTests-1288671137 None] Created volume successfully.
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Flow 'volume_create_manager' (821883e1-a315-4407-9f3c-963239a1f9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f3dcb0-fd5c-4f27-9a06-6238b0392c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f3dcb0-fd5c-4f27-9a06-6238b0392c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a78dab5-e1c8-4c3e-942d-324a486af714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e72f6ef76d643e3bce533b134790e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:50Z,use_quota=True,user_id='1b70a8402e22485e85b420f29a933826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07a50586-8376-4f85-aa23-9e4655273d19),volume_type_id=07a50586-8376-4f85-aa23-9e4655273d19)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82079e37-bf40-4971-ab22-6b715bef35a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82079e37-bf40-4971-ab22-6b715bef35a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d436c09a-3d01-432d-8858-c503f1791a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d436c09a-3d01-432d-8858-c503f1791a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a78dab5-e1c8-4c3e-942d-324a486af714', 'volume_name': 'volume-1a78dab5-e1c8-4c3e-942d-324a486af714', 'volume_size': 1, 'image_id': '29cbdba6-76df-4c3f-832e-f1d436d5933f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29cbdba6-76df-4c3f-832e-f1d436d5933f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '105565dad0499be59c6b472b068bfcc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5e72f6ef76d643e3bce533b134790e25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9584586d445313eca4f7eb458902e929db6397714dcfacd210cd299f855ef8fc2ec0102a1dd63265aeee8e9be6d78638476099ff2d5d4cd48970129ce8b8728', 'id': '29cbdba6-76df-4c3f-832e-f1d436d5933f', 'created_at': datetime.datetime(2026, 9, 11, 4, 30, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 30, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29cbdba6-76df-4c3f-832e-f1d436d5933f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316d59670>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68571377-e173-45f4-89f5-9b663dd8fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68571377-e173-45f4-89f5-9b663dd8fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ec1018-2a2f-4b36-8dbc-af0b2dc1b37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:50 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Volume 1a78dab5-e1c8-4c3e-942d-324a486af714: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a78dab5-e1c8-4c3e-942d-324a486af714', 'volume_size': 1, 'image_id': '29cbdba6-76df-4c3f-832e-f1d436d5933f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29cbdba6-76df-4c3f-832e-f1d436d5933f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '105565dad0499be59c6b472b068bfcc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5e72f6ef76d643e3bce533b134790e25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9584586d445313eca4f7eb458902e929db6397714dcfacd210cd299f855ef8fc2ec0102a1dd63265aeee8e9be6d78638476099ff2d5d4cd48970129ce8b8728', 'id': '29cbdba6-76df-4c3f-832e-f1d436d5933f', 'created_at': datetime.datetime(2026, 9, 11, 4, 30, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 30, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29cbdba6-76df-4c3f-832e-f1d436d5933f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316d59670>}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Trying to clone 1a78dab5-e1c8-4c3e-942d-324a486af714 from image 29cbdba6-76df-4c3f-832e-f1d436d5933f at location (None, [{'url': 'file:///opt/stack/data/glance/images/29cbdba6-76df-4c3f-832e-f1d436d5933f', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-de414d41-343a-4c64-9c6a-09525460685c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-de414d41-343a-4c64-9c6a-09525460685c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-quobyte-de414d41-343a-4c64-9c6a-09525460685c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-de414d41-343a-4c64-9c6a-09525460685c" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:30:50 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b4ebd-ab52-45d9-9085-6ae3184993b7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b325c7d-82a7-4c8b-b68e-dff7a93d1825]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:50 devstack sudo[103898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c
Sep 11 06:30:50 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:50 devstack sudo[103899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD
Sep 11 06:30:50 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:50 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:50 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c" returned: 0 in 0.380s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:50 devstack sudo[103908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c
Sep 11 06:30:50 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:51 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD
Sep 11 06:30:51 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:51 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-de414d41-343a-4c64-9c6a-09525460685c" returned: 0 in 0.261s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-de414d41-343a-4c64-9c6a-09525460685c" released by "delete_volume" :: held 0.689s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:51 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Temporary image 29cbdba6-76df-4c3f-832e-f1d436d5933f is fetched for user 1b70a8402e22485e85b420f29a933826. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Created reservations ['75164b0e-57a9-4287-bb35-0a4e8d9fda94', 'e8f14d94-e8ac-4828-9266-58840150d5ad', 'e5d9af8f-e6ec-495c-b9cc-505b67c06a09', 'de383707-3824-4f59-b392-221ab6e5eebb'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[359cfc0c-681a-4a92-962b-22900af66d43]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:51 devstack sudo[103916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:51 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:51 devstack sudo[103915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD
Sep 11 06:30:51 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:51 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.260s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Deleted volume successfully.
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-623cec76-22ee-44ef-821e-e4cba28572f8 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-de414d41-343a-4c64-9c6a-09525460685c-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:51 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:51 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD
Sep 11 06:30:51 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:52 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a78dab5-e1c8-4c3e-942d-324a486af714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e72f6ef76d643e3bce533b134790e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:50Z,use_quota=True,user_id='1b70a8402e22485e85b420f29a933826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07a50586-8376-4f85-aa23-9e4655273d19),volume_type_id=07a50586-8376-4f85-aa23-9e4655273d19)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Creating volume 1a78dab5-e1c8-4c3e-942d-324a486af714 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:52 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:52 devstack sudo[103927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 1073741824
Sep 11 06:30:52 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (79e37ec2-4756-4b1f-89fa-b8edd1d3b245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07ffaa9-c4f0-4f33-a49d-bd8806cadac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07ffaa9-c4f0-4f33-a49d-bd8806cadac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-326689321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26228f5-5816-4672-b33b-a6d6acb1b266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:52Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea622dbc-120b-4cd9-842a-b41f40b33931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea622dbc-120b-4cd9-842a-b41f40b33931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe0746e-5d08-4f67-87a6-cc58501f6b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe0746e-5d08-4f67-87a6-cc58501f6b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f26228f5-5816-4672-b33b-a6d6acb1b266', 'volume_name': 'volume-f26228f5-5816-4672-b33b-a6d6acb1b266', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b4cce8-c6de-4bec-be77-b8c1377be48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b4cce8-c6de-4bec-be77-b8c1377be48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9246624e-485c-40e5-bad7-3024f1a5705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Volume f26228f5-5816-4672-b33b-a6d6acb1b266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f26228f5-5816-4672-b33b-a6d6acb1b266', 'volume_size': 1}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:52 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 1073741824" returned: 0 in 0.400s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:52 devstack sudo[103932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714
Sep 11 06:30:52 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:52 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714" returned: 0 in 0.241s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-326689321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26228f5-5816-4672-b33b-a6d6acb1b266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:52Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Creating volume f26228f5-5816-4672-b33b-a6d6acb1b266 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:52 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:52 devstack sudo[103935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266 1073741824
Sep 11 06:30:52 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Attempting download of 29cbdba6-76df-4c3f-832e-f1d436d5933f ((None, [{'url': 'file:///opt/stack/data/glance/images/29cbdba6-76df-4c3f-832e-f1d436d5933f', 'metadata': {}}])) to volume 1a78dab5-e1c8-4c3e-942d-324a486af714. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd92e7a-bcf5-4ccc-96e5-2c59773fba61]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29cbdba6-76df-4c3f-832e-f1d436d5933f_fw28plfz {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:52 devstack sudo[103937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29cbdba6-76df-4c3f-832e-f1d436d5933f_fw28plfz
Sep 11 06:30:52 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:53 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266 1073741824" returned: 0 in 0.421s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:53 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29cbdba6-76df-4c3f-832e-f1d436d5933f_fw28plfz" returned: 0 in 0.352s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29cbdba6-76df-4c3f-832e-f1d436d5933f_fw28plfz {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:53 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266
Sep 11 06:30:53 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:53 devstack sudo[103944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29cbdba6-76df-4c3f-832e-f1d436d5933f_fw28plfz
Sep 11 06:30:53 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:53 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266" returned: 0 in 0.248s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9246624e-485c-40e5-bad7-3024f1a5705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f26228f5-5816-4672-b33b-a6d6acb1b266', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c51e45-01da-4235-9abc-64822d8c34c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Volume volume-f26228f5-5816-4672-b33b-a6d6acb1b266 (f26228f5-5816-4672-b33b-a6d6acb1b266): created successfully
Sep 11 06:30:53 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c51e45-01da-4235-9abc-64822d8c34c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (79e37ec2-4756-4b1f-89fa-b8edd1d3b245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29cbdba6-76df-4c3f-832e-f1d436d5933f_fw28plfz" returned: 1 in 0.333s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29cbdba6-76df-4c3f-832e-f1d436d5933f_fw28plfz' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f5468-fffb-4028-ae3b-48ecc5b14a21]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d6cf3efb-cbf6-46c7-bbdc-eacc9880f74a tempest-ProjectReaderTests-1288671137 None] Created volume successfully.
Sep 11 06:30:53 devstack sudo[103951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD
Sep 11 06:30:53 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:53 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:53 devstack sudo[103955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD
Sep 11 06:30:53 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:54 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] 29cbdba6-76df-4c3f-832e-f1d436d5933f was raw, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:54 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714
Sep 11 06:30:54 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-f26228f5-5816-4672-b33b-a6d6acb1b266-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-f26228f5-5816-4672-b33b-a6d6acb1b266-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-quobyte-f26228f5-5816-4672-b33b-a6d6acb1b266" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-f26228f5-5816-4672-b33b-a6d6acb1b266" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fe2ae5-c37a-4845-889d-5a52a07bed0c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:54 devstack sudo[103964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266
Sep 11 06:30:54 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:54 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714" returned: 0 in 0.502s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29cbdba6-76df-4c3f-832e-f1d436d5933f_smbbn4ymdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:30:54 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:54 devstack sudo[103976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 1G
Sep 11 06:30:54 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:54 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266" returned: 0 in 0.408s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:54 devstack sudo[103984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266
Sep 11 06:30:54 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:55 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 1G" returned: 0 in 0.379s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Downloaded image 29cbdba6-76df-4c3f-832e-f1d436d5933f ((None, [{'url': 'file:///opt/stack/data/glance/images/29cbdba6-76df-4c3f-832e-f1d436d5933f', 'metadata': {}}])) to volume 1a78dab5-e1c8-4c3e-942d-324a486af714 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Temporary image 29cbdba6-76df-4c3f-832e-f1d436d5933f for user 1b70a8402e22485e85b420f29a933826 is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:30:55 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Marking volume 1a78dab5-e1c8-4c3e-942d-324a486af714 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f26228f5-5816-4672-b33b-a6d6acb1b266" returned: 0 in 0.285s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-f26228f5-5816-4672-b33b-a6d6acb1b266" released by "delete_volume" :: held 0.739s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Copying metadata from image 29cbdba6-76df-4c3f-832e-f1d436d5933f to 1a78dab5-e1c8-4c3e-942d-324a486af714. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Creating volume glance metadata for volume 1a78dab5-e1c8-4c3e-942d-324a486af714 backed by image 29cbdba6-76df-4c3f-832e-f1d436d5933f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '29cbdba6-76df-4c3f-832e-f1d436d5933f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '105565dad0499be59c6b472b068bfcc5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Created reservations ['408f5b99-4eda-4c2b-9829-4c264fe8842a', '4fe98fb1-8b03-470e-ac5d-2b81ad1f147b', 'b2d78f5a-9b4f-4481-91a8-098888cb756e', '0da098aa-a473-4837-a4a5-93e6b0ca7bab'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ec1018-2a2f-4b36-8dbc-af0b2dc1b37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a78dab5-e1c8-4c3e-942d-324a486af714', 'volume_size': 1, 'image_id': '29cbdba6-76df-4c3f-832e-f1d436d5933f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29cbdba6-76df-4c3f-832e-f1d436d5933f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '105565dad0499be59c6b472b068bfcc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5e72f6ef76d643e3bce533b134790e25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd9584586d445313eca4f7eb458902e929db6397714dcfacd210cd299f855ef8fc2ec0102a1dd63265aeee8e9be6d78638476099ff2d5d4cd48970129ce8b8728', 'id': '29cbdba6-76df-4c3f-832e-f1d436d5933f', 'created_at': datetime.datetime(2026, 9, 11, 4, 30, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 30, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29cbdba6-76df-4c3f-832e-f1d436d5933f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316d59670>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270a26f8-e833-40eb-97a8-873a3d0ab641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:55 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Volume volume-1a78dab5-e1c8-4c3e-942d-324a486af714 (1a78dab5-e1c8-4c3e-942d-324a486af714): created successfully
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270a26f8-e833-40eb-97a8-873a3d0ab641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Flow 'volume_create_manager' (821883e1-a315-4407-9f3c-963239a1f9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b9fc115f-bc34-4398-99b7-ea53f23fd660 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Created volume successfully.
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:55 devstack sudo[103993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:55 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Acquiring lock "cinder-1a78dab5-e1c8-4c3e-942d-324a486af714-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "cinder-1a78dab5-e1c8-4c3e-942d-324a486af714-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Acquiring lock "cinder-quobyte-1a78dab5-e1c8-4c3e-942d-324a486af714" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "cinder-quobyte-1a78dab5-e1c8-4c3e-942d-324a486af714" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f2adcd-4b20-4e17-ba60-c1719f08c10f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:55 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.304s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Deleted volume successfully.
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4288b87-6270-4ea0-8a92-9866e5e68321 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-f26228f5-5816-4672-b33b-a6d6acb1b266-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:55 devstack sudo[103996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714
Sep 11 06:30:55 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:30:55 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (8ae25090-0a2d-4dad-ae63-16ee347bd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620c64fb-019a-41b7-a944-37e4dfca6c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714" returned: 0 in 0.422s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:55 devstack sudo[104001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620c64fb-019a-41b7-a944-37e4dfca6c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916371112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66808978-e13b-4238-bc1a-76df0f735da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:56Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:55 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e2ecfb-7bc1-4d0e-901b-10bedd5bb49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e2ecfb-7bc1-4d0e-901b-10bedd5bb49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dc5ef4-cf46-40d4-9277-06b02652e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dc5ef4-cf46-40d4-9277-06b02652e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66808978-e13b-4238-bc1a-76df0f735da4', 'volume_name': 'volume-66808978-e13b-4238-bc1a-76df0f735da4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67e3d29-b773-4d03-9c5f-1af89d9e2215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67e3d29-b773-4d03-9c5f-1af89d9e2215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b4da4d-da96-4b30-bf12-5c54181afe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:56 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Volume 66808978-e13b-4238-bc1a-76df0f735da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66808978-e13b-4238-bc1a-76df0f735da4', 'volume_size': 1}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916371112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66808978-e13b-4238-bc1a-76df0f735da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030bb235a8c74528a5bf84569a5216ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:30:56Z,use_quota=True,user_id='d54e2d9b98a94fbdb892b14438425b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Creating volume 66808978-e13b-4238-bc1a-76df0f735da4 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:30:56 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:56 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4 1073741824
Sep 11 06:30:56 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:56 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a78dab5-e1c8-4c3e-942d-324a486af714" returned: 0 in 0.256s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "cinder-quobyte-1a78dab5-e1c8-4c3e-942d-324a486af714" released by "delete_volume" :: held 0.727s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:56 devstack cinder-volume[88109]: WARNING cinder.quota [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:30:56 devstack cinder-volume[88109]: WARNING cinder.quota [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Created reservations ['22c069d4-0fdf-42f7-8424-5030d71c1d4d', '574b638b-4d51-4666-8a5a-92d216fce6ef', 'fa351c3d-a043-4afc-8286-ca6044de64f4', '11499374-3e31-4128-8e83-9bda012bfc9c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:56 devstack sudo[104010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:56 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:56 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4 1073741824" returned: 0 in 0.460s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:56 devstack sudo[104012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4
Sep 11 06:30:56 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:56 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.270s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Deleted volume successfully.
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-212abd67-b15d-4459-941e-c7a8e6ba7fc0 tempest-VolumeAndVolumeTypeFromImageTest-1569136557 None] Lock "cinder-1a78dab5-e1c8-4c3e-942d-324a486af714-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:56 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4" returned: 0 in 0.272s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b4da4d-da96-4b30-bf12-5c54181afe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66808978-e13b-4238-bc1a-76df0f735da4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03168d3-ef5c-43fc-bd50-fff850a5b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:30:56 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Volume volume-66808978-e13b-4238-bc1a-76df0f735da4 (66808978-e13b-4238-bc1a-76df0f735da4): created successfully
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03168d3-ef5c-43fc-bd50-fff850a5b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:30:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Flow 'volume_create_manager' (8ae25090-0a2d-4dad-ae63-16ee347bd754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:30:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-81e0cab5-ae3d-4fde-8654-f95ab9155f4e tempest-ProjectReaderTests-1288671137 None] Created volume successfully.
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-66808978-e13b-4238-bc1a-76df0f735da4-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-66808978-e13b-4238-bc1a-76df0f735da4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "cinder-quobyte-66808978-e13b-4238-bc1a-76df0f735da4" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-66808978-e13b-4238-bc1a-76df0f735da4" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8a962-3d07-41fc-9528-302e853a7abb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:58 devstack sudo[104016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4
Sep 11 06:30:58 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:58 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4" returned: 0 in 0.402s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:58 devstack sudo[104022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4
Sep 11 06:30:58 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:58 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-66808978-e13b-4238-bc1a-76df0f735da4" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-quobyte-66808978-e13b-4238-bc1a-76df0f735da4" released by "delete_volume" :: held 0.725s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:30:58 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Created reservations ['f771aca4-353a-4066-b97d-68d5acad79e5', '0eca1b8e-8348-4f15-905f-dae346b75587', 'eee75364-bc6a-48df-bd71-43a17207383b', 'e7a56db9-ce09-48ef-bdd6-0c0f978486b2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:30:59 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:30:59 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:30:59 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:30:59 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Deleted volume successfully.
Sep 11 06:30:59 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-5a3d7fb6-e70e-4300-a50e-0dd85d619cd6 tempest-ProjectReaderTests-1288671137 None] Lock "cinder-66808978-e13b-4238-bc1a-76df0f735da4-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-b49b4e93-a3ea-4c77-964f-0995f4109587 req-6de36a57-c2a4-486a-9930-686ab65f25c9 tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-b49b4e93-a3ea-4c77-964f-0995f4109587 req-6de36a57-c2a4-486a-9930-686ab65f25c9 tempest-TestStampPattern-1906228239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [req-b49b4e93-a3ea-4c77-964f-0995f4109587 req-6de36a57-c2a4-486a-9930-686ab65f25c9 tempest-TestStampPattern-1906228239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (616b8b11-b9dd-44e8-8fba-4bdb2ea1c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe58eff-78c4-494e-a573-cdc82c0d6513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe58eff-78c4-494e-a573-cdc82c0d6513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823466419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2a0fe3-fe3a-4f96-848a-a31219e875f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:01Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a093b15-d4cf-4a7c-acdc-0dd7e4a0bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a093b15-d4cf-4a7c-acdc-0dd7e4a0bd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c530fe-569d-4fd8-bf4d-cd8d0b7fde41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c530fe-569d-4fd8-bf4d-cd8d0b7fde41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2a0fe3-fe3a-4f96-848a-a31219e875f7', 'volume_name': 'volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8684c6b-14cc-451a-948e-185cd454872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8684c6b-14cc-451a-948e-185cd454872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdd4523-5fbb-4adc-bf80-e45c06083b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:01 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume 4b2a0fe3-fe3a-4f96-848a-a31219e875f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7', 'volume_size': 1}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823466419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2a0fe3-fe3a-4f96-848a-a31219e875f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:01Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Creating volume 4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:01 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:01 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-b49b4e93-a3ea-4c77-964f-0995f4109587 req-6de36a57-c2a4-486a-9930-686ab65f25c9 tempest-TestStampPattern-1906228239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0', 'name': 'volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea7f9917-367e-4b13-9b7c-32cf2d5127d0', 'enforce_multipath': True} {{(pid=88109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 06:31:01 devstack sudo[104044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 1073741824
Sep 11 06:31:01 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:01 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-b49b4e93-a3ea-4c77-964f-0995f4109587 req-6de36a57-c2a4-486a-9930-686ab65f25c9 tempest-TestStampPattern-1906228239 None] attachment_update completed successfully.
Sep 11 06:31:02 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 1073741824" returned: 0 in 0.541s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:02 devstack sudo[104435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7
Sep 11 06:31:02 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:02 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" returned: 0 in 0.290s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdd4523-5fbb-4adc-bf80-e45c06083b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6debf72-e8ee-4fc7-95c3-fbc2b72ee48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:02 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 (4b2a0fe3-fe3a-4f96-848a-a31219e875f7): created successfully
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6debf72-e8ee-4fc7-95c3-fbc2b72ee48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (616b8b11-b9dd-44e8-8fba-4bdb2ea1c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f806853c-8b83-452c-85f1-37b4118b9a08 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created volume successfully.
Sep 11 06:31:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Creating offline snapshot a310a893-d0af-4827-8abe-20be93e415dc of volume 4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:31:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a0a364-74fa-458a-8d65-b871583d1b27]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:03 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7
Sep 11 06:31:03 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:04 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" returned: 0 in 0.474s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:04 devstack sudo[104460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc 1G
Sep 11 06:31:04 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [req-6c3d10b5-a3f1-48ea-a7dd-a0a86de2e167 req-d964702d-611b-43f3-ab76-24072fa6815e tempest-TestStampPattern-1906228239 None] Terminate volume connection completed successfully.
Sep 11 06:31:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [req-6c3d10b5-a3f1-48ea-a7dd-a0a86de2e167 req-d964702d-611b-43f3-ab76-24072fa6815e tempest-TestStampPattern-1906228239 None] Deleting attachment ea7f9917-367e-4b13-9b7c-32cf2d5127d0. {{(pid=88109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 06:31:04 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc 1G" returned: 0 in 0.550s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:04 devstack sudo[104492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc
Sep 11 06:31:04 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:05 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:05 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc is being set with open permissions: ugo+rw
Sep 11 06:31:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:05 devstack sudo[104498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc
Sep 11 06:31:05 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:05 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc" returned: 0 in 0.284s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:05 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.info
Sep 11 06:31:05 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:05 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.info" returned: 0 in 0.279s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:05 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.info is being set with open permissions: ugo+rw
Sep 11 06:31:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:05 devstack sudo[104504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.info
Sep 11 06:31:05 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:06 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.info" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fd6cbbb7-f4d5-46b0-8439-fdf471d55afd tempest-CreateVolumesFromSnapshotTest-644317923 None] Create snapshot completed successfully
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (1ccd786d-08af-4511-a008-53a47bfc3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c59dea7-a5a6-48d1-8654-414ef4e435f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c59dea7-a5a6-48d1-8654-414ef4e435f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880398660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e44748-8517-452c-8620-44c507a80a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:08Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a938f49-f867-4755-8175-e4cfac164df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a938f49-f867-4755-8175-e4cfac164df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275f880e-781a-4aff-b0eb-224458702416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275f880e-781a-4aff-b0eb-224458702416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e44748-8517-452c-8620-44c507a80a9e', 'volume_name': 'volume-77e44748-8517-452c-8620-44c507a80a9e', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05000bd6-2ab8-4c0d-921d-ad22e9665ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05000bd6-2ab8-4c0d-921d-ad22e9665ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9979932-94e8-4d10-ac6c-3f9af77981b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:07 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume 77e44748-8517-452c-8620-44c507a80a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e44748-8517-452c-8620-44c507a80a9e', 'volume_size': 1}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880398660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e44748-8517-452c-8620-44c507a80a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:08Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Creating volume 77e44748-8517-452c-8620-44c507a80a9e {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:07 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:07 devstack sudo[104532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e 1073741824
Sep 11 06:31:07 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (690d937e-b51c-460a-8ab5-f8a90d12ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c82543-1718-463c-9663-b01cde809f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c82543-1718-463c-9663-b01cde809f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1336407395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a36341d-890d-4d8f-9fae-3747fd8f7b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:08Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b81eca-ea23-40d8-9a7e-ad08eab850f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b81eca-ea23-40d8-9a7e-ad08eab850f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0b171d-5692-400a-92c4-f753303575df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0b171d-5692-400a-92c4-f753303575df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a36341d-890d-4d8f-9fae-3747fd8f7b82', 'volume_name': 'volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452d29c7-874a-48f5-a006-d07606fdf4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452d29c7-874a-48f5-a006-d07606fdf4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e20c66-0243-48cc-a9ab-2638db98d629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume 1a36341d-890d-4d8f-9fae-3747fd8f7b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82', 'volume_size': 1}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:08 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e 1073741824" returned: 0 in 0.829s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:08 devstack sudo[104540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e
Sep 11 06:31:08 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (807a7a49-726c-4ddd-89d8-f7d9ad1c30c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43fefff-a78a-407c-bbe2-80a763aeec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43fefff-a78a-407c-bbe2-80a763aeec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040255431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a2a317-cb97-4e62-bb3e-520df6434f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:09Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d62aac3-6461-4854-ab5b-a5fb265f6758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d62aac3-6461-4854-ab5b-a5fb265f6758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e72b4b5-2b3c-43db-9b90-28960ea73cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e72b4b5-2b3c-43db-9b90-28960ea73cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a2a317-cb97-4e62-bb3e-520df6434f2f', 'volume_name': 'volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f31bd1-b896-4a6f-bdc5-b7f5605be917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f31bd1-b896-4a6f-bdc5-b7f5605be917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a922ae-4d18-49a0-8595-3eb97b2fedde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume e4a2a317-cb97-4e62-bb3e-520df6434f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f', 'volume_size': 1}
Sep 11 06:31:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:09 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e" returned: 0 in 0.408s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1336407395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a36341d-890d-4d8f-9fae-3747fd8f7b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:08Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Creating volume 1a36341d-890d-4d8f-9fae-3747fd8f7b82 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:09 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9979932-94e8-4d10-ac6c-3f9af77981b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e44748-8517-452c-8620-44c507a80a9e', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5df6adf-c99e-4985-a909-dd56e584245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:09 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume volume-77e44748-8517-452c-8620-44c507a80a9e (77e44748-8517-452c-8620-44c507a80a9e): created successfully
Sep 11 06:31:09 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82 1073741824
Sep 11 06:31:09 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5df6adf-c99e-4985-a909-dd56e584245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (1ccd786d-08af-4511-a008-53a47bfc3070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:09 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0fc5f167-229b-4225-b100-713219981464 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created volume successfully.
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (50c5df90-18f2-4493-ad7c-f067846d71cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423bed71-d2a8-4c14-be36-088e53d06685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423bed71-d2a8-4c14-be36-088e53d06685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616681772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06c8b3e-f773-43de-86bc-6eb7bb601730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:09Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad89619-ad94-449f-980b-8a1474b96b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad89619-ad94-449f-980b-8a1474b96b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3963a3-5077-444b-a84e-439e8c4bc3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3963a3-5077-444b-a84e-439e8c4bc3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f06c8b3e-f773-43de-86bc-6eb7bb601730', 'volume_name': 'volume-f06c8b3e-f773-43de-86bc-6eb7bb601730', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1281a6ce-10a5-4b19-b4e6-35be6a7f04b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1281a6ce-10a5-4b19-b4e6-35be6a7f04b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d51265-38d8-41e8-b2e5-7558f3c0f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:09 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume f06c8b3e-f773-43de-86bc-6eb7bb601730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f06c8b3e-f773-43de-86bc-6eb7bb601730', 'volume_size': 1}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:09 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82 1073741824" returned: 0 in 0.842s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:10 devstack sudo[104551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82
Sep 11 06:31:10 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:10 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (0024a4cd-4f78-4d76-b5f4-f1d2dd3e22f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f14e1-53a7-428b-b6a9-04b28f62959a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82" returned: 0 in 0.390s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040255431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a2a317-cb97-4e62-bb3e-520df6434f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:09Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Creating volume e4a2a317-cb97-4e62-bb3e-520df6434f2f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:10 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f14e1-53a7-428b-b6a9-04b28f62959a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-448965722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:10Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15accad3-c963-4ad0-9452-059a499697ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15accad3-c963-4ad0-9452-059a499697ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:10 devstack sudo[104554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f 1073741824
Sep 11 06:31:10 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30055126-d4d6-43a6-9562-eab91431c477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30055126-d4d6-43a6-9562-eab91431c477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb', 'volume_name': 'volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c5316a-7606-4b07-b2f5-6d8844434041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c5316a-7606-4b07-b2f5-6d8844434041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d7498c-1086-48d2-8277-69d24d436d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb', 'volume_size': 1}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e20c66-0243-48cc-a9ab-2638db98d629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff332007-c441-46af-a179-a3a342119035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82 (1a36341d-890d-4d8f-9fae-3747fd8f7b82): created successfully
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff332007-c441-46af-a179-a3a342119035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (690d937e-b51c-460a-8ab5-f8a90d12ba75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3bd48e8a-30f0-4446-802e-887c864e64a2 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created volume successfully.
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-b0b543f2-8b63-4995-aaed-19f1b27a79b1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Lock "cinder-b0b543f2-8b63-4995-aaed-19f1b27a79b1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-quobyte-b0b543f2-8b63-4995-aaed-19f1b27a79b1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-b0b543f2-8b63-4995-aaed-19f1b27a79b1" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d368beb5-5010-4201-a20a-b18f69cc5e11]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:11 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f 1073741824" returned: 0 in 0.686s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:11 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1
Sep 11 06:31:11 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:11 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f
Sep 11 06:31:11 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:11 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f" returned: 0 in 0.353s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616681772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06c8b3e-f773-43de-86bc-6eb7bb601730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:09Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Creating volume f06c8b3e-f773-43de-86bc-6eb7bb601730 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:11 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:11 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1" returned: 0 in 0.534s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:11 devstack sudo[104569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730 1073741824
Sep 11 06:31:11 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a922ae-4d18-49a0-8595-3eb97b2fedde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27aed02-e4e1-44c3-bc1b-41d7447b299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:11 devstack sudo[104570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1
Sep 11 06:31:11 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:11 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f (e4a2a317-cb97-4e62-bb3e-520df6434f2f): created successfully
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27aed02-e4e1-44c3-bc1b-41d7447b299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (807a7a49-726c-4ddd-89d8-f7d9ad1c30c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6cc472b3-976f-46d1-bb31-b26cdaf3120d tempest-CreateVolumesFromSnapshotTest-644317923 None] Created volume successfully.
Sep 11 06:31:11 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b0b543f2-8b63-4995-aaed-19f1b27a79b1" returned: 0 in 0.384s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-b0b543f2-8b63-4995-aaed-19f1b27a79b1" released by "delete_volume" :: held 0.987s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Created reservations ['f02bb737-efd3-4213-ad33-5fb6e7504f16', '2c4d726c-c1f4-442e-a597-5d2b1733f975', '2e9dfe60-149d-4dde-ac12-81629f740bc0', 'fa1e7338-9de4-41d8-89b2-6c1e4fd553b6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:12 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730 1073741824" returned: 0 in 0.539s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:12 devstack sudo[104578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:12 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:12 devstack sudo[104579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730
Sep 11 06:31:12 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:12 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.248s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Deleted volume successfully.
Sep 11 06:31:12 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730" returned: 0 in 0.260s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-448965722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0900c58ac2b04fce92dccca0be7f13a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:10Z,use_quota=True,user_id='55ca4e5cbcf44c698042a7e0cb1d01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Creating volume bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:12 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d51265-38d8-41e8-b2e5-7558f3c0f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06c8b3e-f773-43de-86bc-6eb7bb601730', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d737db43-d4bf-41aa-8e7c-1da5137cd383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-aa984d5b-28c2-4f12-890e-6ee1ac702626 tempest-TestStampPattern-1906228239 None] Lock "cinder-b0b543f2-8b63-4995-aaed-19f1b27a79b1-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:12 devstack sudo[104584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb 1073741824
Sep 11 06:31:12 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume volume-f06c8b3e-f773-43de-86bc-6eb7bb601730 (f06c8b3e-f773-43de-86bc-6eb7bb601730): created successfully
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d737db43-d4bf-41aa-8e7c-1da5137cd383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (50c5df90-18f2-4493-ad7c-f067846d71cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b9f514f2-4ca7-4705-8abe-517b8bb203c3 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created volume successfully.
Sep 11 06:31:12 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb 1073741824" returned: 0 in 0.521s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:13 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb
Sep 11 06:31:13 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:13 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb" returned: 0 in 0.274s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d7498c-1086-48d2-8277-69d24d436d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d801ac08-f117-48a1-94b4-602b49d2505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Volume volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb (bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb): created successfully
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d801ac08-f117-48a1-94b4-602b49d2505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Flow 'volume_create_manager' (0024a4cd-4f78-4d76-b5f4-f1d2dd3e22f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-94d07916-99f2-4b59-b4a6-3158cd9758fa tempest-CreateVolumesFromSnapshotTest-644317923 None] Created volume successfully.
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-c98d9de9-9344-4db6-ab64-4c32a633dcdc-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Lock "cinder-c98d9de9-9344-4db6-ab64-4c32a633dcdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-quobyte-3853e695-dcce-4367-8da8-28dc7d5aa275" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-3853e695-dcce-4367-8da8-28dc7d5aa275" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-quobyte-c98d9de9-9344-4db6-ab64-4c32a633dcdc" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-c98d9de9-9344-4db6-ab64-4c32a633dcdc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Deleting offline snapshot c98d9de9-9344-4db6-ab64-4c32a633dcdc of volume 3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] snapshot_file for this snap is: volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[de202143-c1ed-45fa-8e73-7927ccd1f774]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:13 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc
Sep 11 06:31:13 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb" acquired by "delete_volume" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b81d9-be73-4b24-9b56-4fbd670ff8e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:14 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc" returned: 0 in 0.473s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3853e695-dcce-4367-8da8-28dc7d5aa275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:31:14 devstack sudo[104595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb
Sep 11 06:31:14 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[890ea4f9-7ca6-4af2-8aed-4f0bc37c67b2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:14 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275
Sep 11 06:31:14 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:14 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb" returned: 0 in 0.464s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:14 devstack sudo[104605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb
Sep 11 06:31:14 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:14 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb" returned: 0 in 0.317s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb" released by "delete_volume" :: held 0.837s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:14 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275" returned: 0 in 0.674s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:14 devstack sudo[104611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc
Sep 11 06:31:14 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created reservations ['415bded6-93b6-40bc-a370-90ab0312d027', '45928d51-c046-4f01-b571-85720334ea55', '8ffa9cc7-74a3-4af0-86b0-c653f895122a', 'a2afed21-0492-456d-8a95-c36b70b1d27c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:14 devstack sudo[104613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:14 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-f06c8b3e-f773-43de-86bc-6eb7bb601730-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-f06c8b3e-f773-43de-86bc-6eb7bb601730-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-f06c8b3e-f773-43de-86bc-6eb7bb601730" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-f06c8b3e-f773-43de-86bc-6eb7bb601730" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[941bfc17-fb51-4d4e-8b3b-131b34d1f354]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:15 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc" returned: 0 in 0.476s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:15 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.352s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:15 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc
Sep 11 06:31:15 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:15 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Deleted volume successfully.
Sep 11 06:31:15 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730
Sep 11 06:31:15 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a45caf02-1eda-4327-8492-d551c8eaca06 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-bfd35889-6f3d-4adb-8e3e-6ad65c58e6eb-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:15 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275.c98d9de9-9344-4db6-ab64-4c32a633dcdc" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-c98d9de9-9344-4db6-ab64-4c32a633dcdc" released by "_delete_snapshot" :: held 2.023s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-3853e695-dcce-4367-8da8-28dc7d5aa275" released by "delete_snapshot" :: held 2.050s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:15 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730" returned: 0 in 0.435s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:15 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730
Sep 11 06:31:15 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Created reservations ['2f7b29e0-bd2b-40b4-85d3-20159d03c76c', '9f56c9a6-a956-4d08-9feb-3cd4f43bcfe8', '8f63b55c-b0e7-45c5-bddb-18950fefdce8', 'bba0e57d-79a6-4949-bb22-4ba8b0f9d14d'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:15 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Delete snapshot completed successfully.
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b5ccb2ce-3f8e-41f9-86de-6e83b0579f0a tempest-TestStampPattern-1906228239 None] Lock "cinder-c98d9de9-9344-4db6-ab64-4c32a633dcdc-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:15 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f06c8b3e-f773-43de-86bc-6eb7bb601730" returned: 0 in 0.287s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-f06c8b3e-f773-43de-86bc-6eb7bb601730" released by "delete_volume" :: held 0.770s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Created reservations ['e2f97cff-11d2-4169-92e4-ed7371de110b', '20aee413-7dcf-43a0-a5b4-8cadca832986', '6fd69bac-c26f-46c1-b759-9daa4e4f6b78', 'ddc0351b-595a-48ed-85cb-91333d37fc2b'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:16 devstack sudo[104631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:16 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-e4a2a317-cb97-4e62-bb3e-520df6434f2f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-e4a2a317-cb97-4e62-bb3e-520df6434f2f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-e4a2a317-cb97-4e62-bb3e-520df6434f2f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:16 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.298s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-e4a2a317-cb97-4e62-bb3e-520df6434f2f" acquired by "delete_volume" :: waited 0.033s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Deleted volume successfully.
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1593ae2-2a19-4f59-a610-4ca3918b5734]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ca8efeea-f421-4829-8b58-92c1be4ca79b tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-f06c8b3e-f773-43de-86bc-6eb7bb601730-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:16 devstack sudo[104634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f
Sep 11 06:31:16 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:16 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f" returned: 0 in 0.403s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:16 devstack sudo[104639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f
Sep 11 06:31:16 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:17 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4a2a317-cb97-4e62-bb3e-520df6434f2f" returned: 0 in 0.311s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-e4a2a317-cb97-4e62-bb3e-520df6434f2f" released by "delete_volume" :: held 0.780s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created reservations ['f45d2c6c-45a3-4cae-b4f8-47a386364dcd', 'bb6371d3-f99f-43fa-ac76-6466a8434b64', '4a5bf3cf-8435-4fb7-9082-d75832e70b6f', 'e14697d9-5356-4ddf-bd1d-1d0ad0166215'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:17 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:17 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-1a36341d-890d-4d8f-9fae-3747fd8f7b82-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-1a36341d-890d-4d8f-9fae-3747fd8f7b82-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-1a36341d-890d-4d8f-9fae-3747fd8f7b82" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:17 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.348s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-1a36341d-890d-4d8f-9fae-3747fd8f7b82" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:17 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Deleted volume successfully.
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb3665f-a6b2-4322-9d54-619f1871de5b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-02e9077b-4064-4c4d-8f0b-94ddffebde98 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-e4a2a317-cb97-4e62-bb3e-520df6434f2f-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:17 devstack sudo[104647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82
Sep 11 06:31:17 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:18 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82" returned: 0 in 0.499s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:18 devstack sudo[104656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82
Sep 11 06:31:18 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:18 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-1a36341d-890d-4d8f-9fae-3747fd8f7b82" returned: 0 in 0.495s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-1a36341d-890d-4d8f-9fae-3747fd8f7b82" released by "delete_volume" :: held 1.061s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Created reservations ['3288e8a5-8b04-43bb-a8c4-acc6288dca9c', '4da23ea0-e954-47f3-a4e6-c8afa2b67d69', '2ebea15f-db91-4186-8184-72a36c075cbb', 'cbf95402-4946-4f02-a439-8ec61056b109'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:18 devstack sudo[104679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:18 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:19 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.295s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Deleted volume successfully.
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9fa1ca0e-0cd3-48af-ae3b-82497307718c tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-1a36341d-890d-4d8f-9fae-3747fd8f7b82-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-77e44748-8517-452c-8620-44c507a80a9e-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-77e44748-8517-452c-8620-44c507a80a9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-77e44748-8517-452c-8620-44c507a80a9e" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-77e44748-8517-452c-8620-44c507a80a9e" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f7b9d-b5f9-4c94-95b0-d72399f08170]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:20 devstack sudo[104685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e
Sep 11 06:31:20 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:20 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e" returned: 0 in 0.397s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:20 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e
Sep 11 06:31:20 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:20 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-77e44748-8517-452c-8620-44c507a80a9e" returned: 0 in 0.245s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-77e44748-8517-452c-8620-44c507a80a9e" released by "delete_volume" :: held 0.688s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Created reservations ['66959438-f035-47f5-a3f3-5f7319dcf28b', '518117de-2708-4b1c-bb91-c8c45d785047', '6d9bb18b-f3d5-4b04-9c53-df3f622ab6c6', '9d60768d-b629-4d54-a65d-eab6f08f193c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-3853e695-dcce-4367-8da8-28dc7d5aa275-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Lock "cinder-3853e695-dcce-4367-8da8-28dc7d5aa275-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:20 devstack sudo[104693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:20 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Acquiring lock "cinder-quobyte-3853e695-dcce-4367-8da8-28dc7d5aa275" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-3853e695-dcce-4367-8da8-28dc7d5aa275" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[be725307-1b04-4d51-be4c-a08921982c77]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:21 devstack sudo[104695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275
Sep 11 06:31:21 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-a310a893-d0af-4827-8abe-20be93e415dc-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:21 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.340s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-a310a893-d0af-4827-8abe-20be93e415dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:21 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Deleted volume successfully.
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-a310a893-d0af-4827-8abe-20be93e415dc" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-ec111d81-3593-46a0-9de0-0ac9b4d10dbf tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-77e44748-8517-452c-8620-44c507a80a9e-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-a310a893-d0af-4827-8abe-20be93e415dc" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Deleting offline snapshot a310a893-d0af-4827-8abe-20be93e415dc of volume 4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] snapshot_file for this snap is: volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75d36ee-37c7-4d93-a437-aa0435222996]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:21 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc
Sep 11 06:31:21 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:21 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275" returned: 0 in 0.536s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:21 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275
Sep 11 06:31:21 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:21 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc" returned: 0 in 0.391s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:31:21 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3853e695-dcce-4367-8da8-28dc7d5aa275" returned: 0 in 0.292s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1f3143-3e98-4cc0-9993-425d9d1b7657]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Lock "cinder-quobyte-3853e695-dcce-4367-8da8-28dc7d5aa275" released by "delete_volume" :: held 0.912s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Created reservations ['7fb6f46d-68d0-4510-a585-44aa2411c7a6', '05c48268-a54e-45c8-97d2-56d31078f0d0', '073fbb71-4e27-432a-a300-03308580803b', '27bb594c-f7eb-4948-b42b-9732ba2ec5b0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:21 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7
Sep 11 06:31:21 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:21 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:21 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:22 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" returned: 0 in 0.486s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:22 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:22 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc
Sep 11 06:31:22 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:22 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Deleted volume successfully.
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c6fc2299-c2c6-4b22-a1bf-f1f04cc7c3cc tempest-TestStampPattern-1906228239 None] Lock "cinder-3853e695-dcce-4367-8da8-28dc7d5aa275-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:22 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc" returned: 0 in 0.415s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:22 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc
Sep 11 06:31:22 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:22 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7.a310a893-d0af-4827-8abe-20be93e415dc" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-a310a893-d0af-4827-8abe-20be93e415dc" released by "_delete_snapshot" :: held 1.763s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" released by "delete_snapshot" :: held 1.813s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created reservations ['ead86974-fa92-4c81-a018-46dd98791fd1', 'be90b43b-6844-4143-b07f-b30098e1277d', '08b7f46a-e825-4fe3-a67c-6aee14a2505e', 'ad452625-4d24-4f9d-81b3-d03919d93003'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:23 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Delete snapshot completed successfully.
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f1785611-eab6-42d4-9305-5d68d6589f76 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-a310a893-d0af-4827-8abe-20be93e415dc-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-4b2a0fe3-fe3a-4f96-848a-a31219e875f7-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-4b2a0fe3-fe3a-4f96-848a-a31219e875f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "cinder-quobyte-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" acquired by "delete_volume" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54d54d7-0224-4da2-b9cf-94d4025dbfcd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:23 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7
Sep 11 06:31:23 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:23 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" returned: 0 in 0.444s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:23 devstack sudo[104732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7
Sep 11 06:31:23 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:24 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" returned: 0 in 0.294s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-quobyte-4b2a0fe3-fe3a-4f96-848a-a31219e875f7" released by "delete_volume" :: held 0.835s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Created reservations ['b17084d9-6049-4a39-afcb-6ed81e9165dd', '2a20656d-eb33-43a1-b553-5fb4ecd5a960', '43eb9b34-89df-4d47-9e07-90842290f155', '8187317e-911f-4fbd-8469-ae0d76aade7b'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:24 devstack sudo[104736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:24 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:24 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.305s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:24 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Deleted volume successfully.
Sep 11 06:31:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-949b6b2e-8975-4fee-9ba2-7b54ec4db9b4 tempest-CreateVolumesFromSnapshotTest-644317923 None] Lock "cinder-4b2a0fe3-fe3a-4f96-848a-a31219e875f7-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Flow 'volume_create_manager' (614edef5-f914-4a89-90ee-f72145653f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce99ba43-ba88-4705-ba55-0370a08a2a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce99ba43-ba88-4705-ba55-0370a08a2a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-558421737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f45c3f-6f21-4f42-80ea-c35fc942a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7108c63ace9a4833aa3e7fffb0e0c90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:28Z,use_quota=True,user_id='314f55195cb445a9839b30d2ef33863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f7aecf-e1ba-4e11-9250-a542de6343e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f7aecf-e1ba-4e11-9250-a542de6343e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc68200-8c70-4d5b-8041-811cba34beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc68200-8c70-4d5b-8041-811cba34beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f45c3f-6f21-4f42-80ea-c35fc942a96f', 'volume_name': 'volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66e18f7-4b2f-436c-a4f4-bea350909a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66e18f7-4b2f-436c-a4f4-bea350909a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea704c7-1d01-433e-ac09-54713144159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:28 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Volume b1f45c3f-6f21-4f42-80ea-c35fc942a96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f', 'volume_size': 1}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-558421737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f45c3f-6f21-4f42-80ea-c35fc942a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7108c63ace9a4833aa3e7fffb0e0c90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:28Z,use_quota=True,user_id='314f55195cb445a9839b30d2ef33863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Creating volume b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:28 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:28 devstack sudo[104740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f 1073741824
Sep 11 06:31:28 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:28 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f 1073741824" returned: 0 in 0.519s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:28 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f
Sep 11 06:31:28 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:29 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" returned: 0 in 0.292s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea704c7-1d01-433e-ac09-54713144159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a86279-f16f-4c88-b08f-aeac310066ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:29 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Volume volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f (b1f45c3f-6f21-4f42-80ea-c35fc942a96f): created successfully
Sep 11 06:31:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a86279-f16f-4c88-b08f-aeac310066ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Flow 'volume_create_manager' (614edef5-f914-4a89-90ee-f72145653f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-68ad0907-c017-4aa8-9824-9571c2801749 tempest-SnapshotDependencyTests-223116056 None] Created volume successfully.
Sep 11 06:31:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Creating offline snapshot 972a1e18-355d-40e8-99bc-d49c83ac30ab of volume b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:31:30 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3408042f-c577-4e03-94c4-19648525d6b5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:30 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f
Sep 11 06:31:30 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:30 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" returned: 0 in 0.401s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:30 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab 1G
Sep 11 06:31:30 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:31 devstack sudo[104759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:31 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:31 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab 1G" returned: 0 in 0.473s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:31 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.301s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:31:31 devstack sudo[104766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab
Sep 11 06:31:31 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:31 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab" returned: 0 in 0.383s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:31 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab is being set with open permissions: ugo+rw
Sep 11 06:31:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:31 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab
Sep 11 06:31:31 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:32 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:32 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.info
Sep 11 06:31:32 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:32 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.info" returned: 0 in 0.309s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:32 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.info is being set with open permissions: ugo+rw
Sep 11 06:31:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:32 devstack sudo[104780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.info
Sep 11 06:31:32 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:32 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.info" returned: 0 in 0.343s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:32 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-530e1d5c-1556-4a41-a0e1-173f3b24f92d tempest-SnapshotDependencyTests-223116056 None] Create snapshot completed successfully
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Flow 'volume_create_manager' (0a4d6a48-fa00-49be-b8a5-d2f5c999c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e5f24d-c94f-4fa3-97a7-92a8a09e0bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e5f24d-c94f-4fa3-97a7-92a8a09e0bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88508d5c-04ad-46fe-853a-cb420a3599f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7108c63ace9a4833aa3e7fffb0e0c90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=972a1e18-355d-40e8-99bc-d49c83ac30ab,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:34Z,use_quota=True,user_id='314f55195cb445a9839b30d2ef33863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01659a56-35a2-480e-b1dd-21c1e2ce8398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01659a56-35a2-480e-b1dd-21c1e2ce8398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a428b08-fa6c-42eb-b68d-a690f4adb5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a428b08-fa6c-42eb-b68d-a690f4adb5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88508d5c-04ad-46fe-853a-cb420a3599f8', 'volume_name': 'volume-88508d5c-04ad-46fe-853a-cb420a3599f8', 'volume_size': 1, 'snapshot_id': '972a1e18-355d-40e8-99bc-d49c83ac30ab'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc8aef8-5815-4223-8280-fd7e830b0695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc8aef8-5815-4223-8280-fd7e830b0695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ad82ca-7e0e-4831-99d5-487daa84c86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:34 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Volume 88508d5c-04ad-46fe-853a-cb420a3599f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88508d5c-04ad-46fe-853a-cb420a3599f8', 'volume_size': 1, 'snapshot_id': '972a1e18-355d-40e8-99bc-d49c83ac30ab'}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-quobyte-972a1e18-355d-40e8-99bc-d49c83ac30ab-88508d5c-04ad-46fe-853a-cb420a3599f8" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-972a1e18-355d-40e8-99bc-d49c83ac30ab-88508d5c-04ad-46fe-853a-cb420a3599f8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Creating volume 88508d5c-04ad-46fe-853a-cb420a3599f8 from snapshot 972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-quobyte-88508d5c-04ad-46fe-853a-cb420a3599f8" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-88508d5c-04ad-46fe-853a-cb420a3599f8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] snapshot: 972a1e18-355d-40e8-99bc-d49c83ac30ab, volume: 88508d5c-04ad-46fe-853a-cb420a3599f8,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c4ca26-dab2-440d-8d5b-23003eb6e3e9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:34 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab
Sep 11 06:31:34 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:34 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab" returned: 0 in 0.395s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018b484-6c44-4bf4-946d-23b9c3c00e81]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:35 devstack sudo[104824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f
Sep 11 06:31:35 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:35 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" returned: 0 in 0.393s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:31:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:31:35 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:31:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:35 devstack sudo[104829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8
Sep 11 06:31:35 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (9cdbfabd-861e-445c-abae-604fe0215f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1a4806-4616-4d15-8931-f4948386624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1a4806-4616-4d15-8931-f4948386624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1632637669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315f2b34-613d-4186-97f9-7ef4954f5126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:36Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e148fc46-fcb7-445f-9f41-9f59ec3e6e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e148fc46-fcb7-445f-9f41-9f59ec3e6e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13458a5-94ee-4b5d-8a00-3189a633736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13458a5-94ee-4b5d-8a00-3189a633736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315f2b34-613d-4186-97f9-7ef4954f5126', 'volume_name': 'volume-315f2b34-613d-4186-97f9-7ef4954f5126', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a015bd-244b-483b-8cd7-4cdff798eb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a015bd-244b-483b-8cd7-4cdff798eb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66b4f32-0787-4c52-a0dc-9d2d2807ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:36 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume 315f2b34-613d-4186-97f9-7ef4954f5126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315f2b34-613d-4186-97f9-7ef4954f5126', 'volume_size': 1}
Sep 11 06:31:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:39 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8" returned: 0 in 4.333s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:31:39 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Converted 1024.00 MB image at 236.29 MB/s
Sep 11 06:31:39 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8 is being set with open permissions: ugo+rw
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:39 devstack sudo[104843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8
Sep 11 06:31:39 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:39 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-88508d5c-04ad-46fe-853a-cb420a3599f8" released by "_copy_volume_from_snapshot" :: held 5.455s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=135,cinder:INSERT=50,cinder:UPDATE=168,cinder:DELETE=14 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=132,cinder:INSERT=42,cinder:UPDATE=180,cinder:DELETE=15 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-972a1e18-355d-40e8-99bc-d49c83ac30ab-88508d5c-04ad-46fe-853a-cb420a3599f8" released by "_create_volume_from_snapshot" :: held 5.524s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.547s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1632637669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315f2b34-613d-4186-97f9-7ef4954f5126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:36Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Creating volume 315f2b34-613d-4186-97f9-7ef4954f5126 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:40 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:40 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126 1073741824
Sep 11 06:31:40 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ad82ca-7e0e-4831-99d5-487daa84c86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88508d5c-04ad-46fe-853a-cb420a3599f8', 'volume_size': 1, 'snapshot_id': '972a1e18-355d-40e8-99bc-d49c83ac30ab'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ec01d8-08ea-4e35-a70e-b58a8a0e256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:40 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Volume volume-88508d5c-04ad-46fe-853a-cb420a3599f8 (88508d5c-04ad-46fe-853a-cb420a3599f8): created successfully
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ec01d8-08ea-4e35-a70e-b58a8a0e256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Flow 'volume_create_manager' (0a4d6a48-fa00-49be-b8a5-d2f5c999c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e1e90eec-4a2e-4735-b14e-f826b984e80d tempest-SnapshotDependencyTests-223116056 None] Created volume successfully.
Sep 11 06:31:40 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126 1073741824" returned: 0 in 0.391s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:40 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126
Sep 11 06:31:40 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:40 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126" returned: 0 in 0.241s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66b4f32-0787-4c52-a0dc-9d2d2807ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315f2b34-613d-4186-97f9-7ef4954f5126', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054b5d06-3fe1-4c54-a9b5-2ac5477ad66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:40 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume volume-315f2b34-613d-4186-97f9-7ef4954f5126 (315f2b34-613d-4186-97f9-7ef4954f5126): created successfully
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054b5d06-3fe1-4c54-a9b5-2ac5477ad66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (9cdbfabd-861e-445c-abae-604fe0215f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a888a2db-0aa2-440a-90d1-557d16df4f73 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created volume successfully.
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-972a1e18-355d-40e8-99bc-d49c83ac30ab-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-972a1e18-355d-40e8-99bc-d49c83ac30ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-quobyte-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-quobyte-972a1e18-355d-40e8-99bc-d49c83ac30ab" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-972a1e18-355d-40e8-99bc-d49c83ac30ab" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Deleting offline snapshot 972a1e18-355d-40e8-99bc-d49c83ac30ab of volume b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] snapshot_file for this snap is: volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0132d842-5991-46a3-b05b-f8cee5726016]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:41 devstack sudo[104855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab
Sep 11 06:31:41 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:41 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:31:41 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9833cb-b2c5-4641-9949-c23f2fccf431]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:41 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f
Sep 11 06:31:41 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:41 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" returned: 0 in 0.556s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:41 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab
Sep 11 06:31:41 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (2c3e44f2-63b9-4f51-940c-a44835ed1991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ac4493-5f19-4842-ae96-15ab1e182e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab" returned: 0 in 0.377s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ac4493-5f19-4842-ae96-15ab1e182e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1996357402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a406369-537b-40d3-8a12-1c64d329c223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:42Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack sudo[104871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab
Sep 11 06:31:42 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b153e4fd-9eb5-4849-828d-9fbbf7b9b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b153e4fd-9eb5-4849-828d-9fbbf7b9b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfe5c34-dd15-422f-ad96-eebba877fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfe5c34-dd15-422f-ad96-eebba877fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a406369-537b-40d3-8a12-1c64d329c223', 'volume_name': 'volume-3a406369-537b-40d3-8a12-1c64d329c223', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b414ce8-b0fb-4349-9451-c2077eb1666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b414ce8-b0fb-4349-9451-c2077eb1666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b19fea3-c4fb-401d-b36c-6ad7770d94e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume 3a406369-537b-40d3-8a12-1c64d329c223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a406369-537b-40d3-8a12-1c64d329c223', 'volume_size': 1}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1996357402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a406369-537b-40d3-8a12-1c64d329c223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:42Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Creating volume 3a406369-537b-40d3-8a12-1c64d329c223 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:42 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:42 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223 1073741824
Sep 11 06:31:42 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:42 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f.972a1e18-355d-40e8-99bc-d49c83ac30ab" returned: 0 in 0.315s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (22753d98-a59b-4f03-a4d3-47fa0bb90d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd14fdb-0112-4513-aadb-1008141fe565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-972a1e18-355d-40e8-99bc-d49c83ac30ab" released by "_delete_snapshot" :: held 1.747s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" released by "delete_snapshot" :: held 1.779s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd14fdb-0112-4513-aadb-1008141fe565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145939134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b878c7-cc74-4921-8903-20b748a144a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:43Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4772c3ca-5097-4a3e-8d80-5b270f66117a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4772c3ca-5097-4a3e-8d80-5b270f66117a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd95722b-6937-4d37-a352-5c113fdd3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd95722b-6937-4d37-a352-5c113fdd3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b878c7-cc74-4921-8903-20b748a144a5', 'volume_name': 'volume-48b878c7-cc74-4921-8903-20b748a144a5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36537958-f8ff-4cdf-8ff7-b0beda7e1aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36537958-f8ff-4cdf-8ff7-b0beda7e1aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5500dcbb-c5d5-49df-a28a-30889c3a2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:42 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume 48b878c7-cc74-4921-8903-20b748a144a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b878c7-cc74-4921-8903-20b748a144a5', 'volume_size': 1}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Created reservations ['f6af7890-65b3-41bf-a7b2-9df8568c94ca', '8c102d3a-c07d-4cc7-93c5-e53d5e1bea36', '87a30a59-573b-466d-8749-2cc36963f463', '50cce155-70c5-479e-9718-b3092c4e301a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Delete snapshot completed successfully.
Sep 11 06:31:42 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223 1073741824" returned: 0 in 0.526s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b1215b93-6ea9-40e7-88e1-ab28dca96070 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-972a1e18-355d-40e8-99bc-d49c83ac30ab-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:42 devstack sudo[104880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223
Sep 11 06:31:42 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (4aa44f9f-e247-4ec7-a525-0b67a1e86b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a7354c-e855-4814-a2ec-78a0057e8ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a7354c-e855-4814-a2ec-78a0057e8ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415819552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6903fe72-5cf0-4390-bfaa-b1d820a12d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:43Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aee6825-6349-42da-8d02-a6f1c718fa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aee6825-6349-42da-8d02-a6f1c718fa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b687d7-59c2-4f81-87d1-ecbfed08672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b687d7-59c2-4f81-87d1-ecbfed08672c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6903fe72-5cf0-4390-bfaa-b1d820a12d00', 'volume_name': 'volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef7556d-d379-4583-9ba9-4899e18bf0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef7556d-d379-4583-9ba9-4899e18bf0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721d2d9d-9a07-4d22-aebd-7d1117966034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume 6903fe72-5cf0-4390-bfaa-b1d820a12d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00', 'volume_size': 1}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-b1f45c3f-6f21-4f42-80ea-c35fc942a96f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-b1f45c3f-6f21-4f42-80ea-c35fc942a96f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-quobyte-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" acquired by "delete_volume" :: waited 0.014s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:43 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223" returned: 0 in 0.325s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2145939134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b878c7-cc74-4921-8903-20b748a144a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:43Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Creating volume 48b878c7-cc74-4921-8903-20b748a144a5 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:43 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7782d312-735c-49cd-aa2d-002b0320dfd5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:43 devstack sudo[104883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5 1073741824
Sep 11 06:31:43 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b19fea3-c4fb-401d-b36c-6ad7770d94e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a406369-537b-40d3-8a12-1c64d329c223', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dd2850-8c20-4b0c-b683-2419f5c9b27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume volume-3a406369-537b-40d3-8a12-1c64d329c223 (3a406369-537b-40d3-8a12-1c64d329c223): created successfully
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dd2850-8c20-4b0c-b683-2419f5c9b27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (2c3e44f2-63b9-4f51-940c-a44835ed1991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b3260e0a-fcfa-418e-85e5-1792641bf75c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created volume successfully.
Sep 11 06:31:43 devstack sudo[104884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f
Sep 11 06:31:43 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (c20b6ff1-aa95-4ddc-a814-8328f0485a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93a4fe9-5d0c-4f3f-a52a-fbad0af02789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93a4fe9-5d0c-4f3f-a52a-fbad0af02789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22282302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e115e03c-786c-4781-8b60-adc5e68a297d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:43Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5544a4a-7880-4a72-8359-b3b901651530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5544a4a-7880-4a72-8359-b3b901651530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0d59f5-38bf-47a3-9bc4-5ebafc3c8f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0d59f5-38bf-47a3-9bc4-5ebafc3c8f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e115e03c-786c-4781-8b60-adc5e68a297d', 'volume_name': 'volume-e115e03c-786c-4781-8b60-adc5e68a297d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f7ec3a-87d2-4d2d-ab3c-0b32bc4c6862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f7ec3a-87d2-4d2d-ab3c-0b32bc4c6862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10af9885-5fe1-4786-8688-08c3ccc7cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume e115e03c-786c-4781-8b60-adc5e68a297d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e115e03c-786c-4781-8b60-adc5e68a297d', 'volume_size': 1}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:43 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" returned: 0 in 0.465s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:43 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5 1073741824" returned: 0 in 0.510s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:43 devstack sudo[104894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f
Sep 11 06:31:43 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:43 devstack sudo[104896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5
Sep 11 06:31:43 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (12cf9018-9764-4f0b-8133-3c05a525daae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b34f934-31c9-4568-8a9f-5deea6d23b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b34f934-31c9-4568-8a9f-5deea6d23b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147985134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11515f68-76e3-4f95-832f-46497bdeffee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:44Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2824aa7-5564-441b-a677-48e613aa6ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2824aa7-5564-441b-a677-48e613aa6ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df200aa7-67e1-4b56-827b-805cbfc01bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df200aa7-67e1-4b56-827b-805cbfc01bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11515f68-76e3-4f95-832f-46497bdeffee', 'volume_name': 'volume-11515f68-76e3-4f95-832f-46497bdeffee', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0fa05-191d-4fb7-ab54-5806b0d9131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0fa05-191d-4fb7-ab54-5806b0d9131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d22bef-8d50-4091-9d76-1948867b70c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume 11515f68-76e3-4f95-832f-46497bdeffee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11515f68-76e3-4f95-832f-46497bdeffee', 'volume_size': 1}
Sep 11 06:31:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:44 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" returned: 0 in 0.287s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-b1f45c3f-6f21-4f42-80ea-c35fc942a96f" released by "delete_volume" :: held 0.856s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Created reservations ['3abecb36-2b11-42b9-86e0-c12250dc8566', '6d9cf078-a2e5-480f-8fbb-22c93bb3c3ac', 'ff3e2504-7569-4784-8aad-ebd81e215aeb', '6e6931bf-5738-4e1e-bbbb-7c269e6e5db0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:44 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5" returned: 0 in 0.278s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-415819552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6903fe72-5cf0-4390-bfaa-b1d820a12d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:43Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Creating volume 6903fe72-5cf0-4390-bfaa-b1d820a12d00 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:44 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:44 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00 1073741824
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5500dcbb-c5d5-49df-a28a-30889c3a2471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b878c7-cc74-4921-8903-20b748a144a5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:44 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ef575d-1e01-4542-8bc0-41c87e735fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:44 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume volume-48b878c7-cc74-4921-8903-20b748a144a5 (48b878c7-cc74-4921-8903-20b748a144a5): created successfully
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ef575d-1e01-4542-8bc0-41c87e735fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (22753d98-a59b-4f03-a4d3-47fa0bb90d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:44 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-11999574-ab6e-4611-bbfa-9c4ea81c6f7c tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created volume successfully.
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:44 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:44 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-88508d5c-04ad-46fe-853a-cb420a3599f8-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-88508d5c-04ad-46fe-853a-cb420a3599f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "cinder-quobyte-88508d5c-04ad-46fe-853a-cb420a3599f8" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-88508d5c-04ad-46fe-853a-cb420a3599f8" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a758065f-d210-4b5b-8488-a9dba2e35ac2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:44 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8
Sep 11 06:31:44 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:44 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.314s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:44 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Deleted volume successfully.
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-10a0b1e6-6dd5-466f-b36b-dbb2132e186c tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-b1f45c3f-6f21-4f42-80ea-c35fc942a96f-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:44 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00 1073741824" returned: 0 in 0.505s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:44 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00
Sep 11 06:31:44 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:44 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:44 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8
Sep 11 06:31:44 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:44 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00" returned: 0 in 0.270s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22282302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e115e03c-786c-4781-8b60-adc5e68a297d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:43Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Creating volume e115e03c-786c-4781-8b60-adc5e68a297d {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:44 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721d2d9d-9a07-4d22-aebd-7d1117966034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:45 devstack sudo[104925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d 1073741824
Sep 11 06:31:45 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e4c71-e650-4d02-ab2b-4e9fac1cc864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00 (6903fe72-5cf0-4390-bfaa-b1d820a12d00): created successfully
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e4c71-e650-4d02-ab2b-4e9fac1cc864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (4aa44f9f-e247-4ec7-a525-0b67a1e86b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-174b4963-e605-48bc-9ce2-8a2e1e617095 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created volume successfully.
Sep 11 06:31:45 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-88508d5c-04ad-46fe-853a-cb420a3599f8" returned: 0 in 0.264s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-quobyte-88508d5c-04ad-46fe-853a-cb420a3599f8" released by "delete_volume" :: held 0.690s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Created reservations ['daf30b33-5ebe-43c6-a73d-60b55ed90691', '18bf89aa-4af8-4022-90fd-a23c3c3f76cf', '1cf37e15-b3d4-4b00-95e6-8688be9ca7f0', '0a6a0596-459d-4399-a4eb-2b10f1748db3'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:45 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:45 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:45 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d 1073741824" returned: 0 in 0.405s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:45 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.269s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Deleted volume successfully.
Sep 11 06:31:45 devstack sudo[104934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d
Sep 11 06:31:45 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-72e4be56-d18b-47ed-be27-1736f8702618 tempest-SnapshotDependencyTests-223116056 None] Lock "cinder-88508d5c-04ad-46fe-853a-cb420a3599f8-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:45 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147985134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11515f68-76e3-4f95-832f-46497bdeffee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec769e9b7844034955d15dfd3c81503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:44Z,use_quota=True,user_id='cb8930d393a94bc7a3704f1b057ac0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Creating volume 11515f68-76e3-4f95-832f-46497bdeffee {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:45 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:45 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee 1073741824
Sep 11 06:31:45 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10af9885-5fe1-4786-8688-08c3ccc7cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e115e03c-786c-4781-8b60-adc5e68a297d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bee874-b0d4-4f5a-9255-41d3915c1187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:45 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume volume-e115e03c-786c-4781-8b60-adc5e68a297d (e115e03c-786c-4781-8b60-adc5e68a297d): created successfully
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bee874-b0d4-4f5a-9255-41d3915c1187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:45 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (c20b6ff1-aa95-4ddc-a814-8328f0485a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-71d420fb-db6a-4251-8ef7-33a9f4cb39aa tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created volume successfully.
Sep 11 06:31:46 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee 1073741824" returned: 0 in 0.502s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:46 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee
Sep 11 06:31:46 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:46 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee" returned: 0 in 0.261s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d22bef-8d50-4091-9d76-1948867b70c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11515f68-76e3-4f95-832f-46497bdeffee', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf0badf-36db-46cd-8fdc-b9e4ac1fc959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:46 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Volume volume-11515f68-76e3-4f95-832f-46497bdeffee (11515f68-76e3-4f95-832f-46497bdeffee): created successfully
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf0badf-36db-46cd-8fdc-b9e4ac1fc959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:46 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Flow 'volume_create_manager' (12cf9018-9764-4f0b-8133-3c05a525daae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-19d5aadb-b5e6-42ab-8275-09059e1a4e6e tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created volume successfully.
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-11515f68-76e3-4f95-832f-46497bdeffee-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-11515f68-76e3-4f95-832f-46497bdeffee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-quobyte-11515f68-76e3-4f95-832f-46497bdeffee" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-11515f68-76e3-4f95-832f-46497bdeffee" acquired by "delete_volume" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2177ea-7eb0-454a-a121-6b85026e1008]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:47 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee
Sep 11 06:31:47 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:47 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee" returned: 0 in 0.390s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:47 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee
Sep 11 06:31:47 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:48 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-11515f68-76e3-4f95-832f-46497bdeffee" returned: 0 in 0.275s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-11515f68-76e3-4f95-832f-46497bdeffee" released by "delete_volume" :: held 0.706s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created reservations ['85152eed-ffce-4750-9e37-16e5d5ab62d8', '485081fb-cb47-423a-a75a-2ac7596969c2', '7a076db2-dc61-4ec0-a365-169c854b9289', '26ab8e4a-fe96-4b90-b54f-ce550cc90934'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:48 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:48 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:48 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.243s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Deleted volume successfully.
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-016b3986-02af-4354-b9e1-59ee6b656acb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-11515f68-76e3-4f95-832f-46497bdeffee-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-e115e03c-786c-4781-8b60-adc5e68a297d-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-e115e03c-786c-4781-8b60-adc5e68a297d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-quobyte-e115e03c-786c-4781-8b60-adc5e68a297d" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-e115e03c-786c-4781-8b60-adc5e68a297d" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14ea1a-8ed4-4dd7-ada5-9a0d28bfee86]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:48 devstack sudo[104959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d
Sep 11 06:31:48 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:49 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d" returned: 0 in 0.439s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:49 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d
Sep 11 06:31:49 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:49 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e115e03c-786c-4781-8b60-adc5e68a297d" returned: 0 in 0.270s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-e115e03c-786c-4781-8b60-adc5e68a297d" released by "delete_volume" :: held 0.753s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created reservations ['db11a4d2-980d-498c-8ff7-00cf260eff9e', '296d4874-4eb6-47ee-bbba-d611b1203166', '6069b845-7bf7-489f-9010-cbfa11142d8c', '28e3f9f5-87de-4ab0-9e55-c12e5724e8d3'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:49 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:49 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-6903fe72-5cf0-4390-bfaa-b1d820a12d00-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-6903fe72-5cf0-4390-bfaa-b1d820a12d00-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:49 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-quobyte-6903fe72-5cf0-4390-bfaa-b1d820a12d00" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.361s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:49 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Deleted volume successfully.
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-6903fe72-5cf0-4390-bfaa-b1d820a12d00" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[de19d9f6-9e08-42d2-b22f-ef81dce54aa7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-447f06cf-9545-40b4-9c43-8e18432d6347 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-e115e03c-786c-4781-8b60-adc5e68a297d-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:49 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00
Sep 11 06:31:49 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:50 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00" returned: 0 in 0.374s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:50 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00
Sep 11 06:31:50 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:50 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6903fe72-5cf0-4390-bfaa-b1d820a12d00" returned: 0 in 0.265s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-6903fe72-5cf0-4390-bfaa-b1d820a12d00" released by "delete_volume" :: held 0.685s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created reservations ['c2a44764-52da-47ac-b5f5-9e6776e0219c', 'ee62e9b4-e88d-4a00-8cfb-769908e09f36', 'ca63068e-f365-4eb4-8cdc-d23bb6773044', '91deee38-c71b-424d-814f-9e8443961b31'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:50 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:50 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-48b878c7-cc74-4921-8903-20b748a144a5-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-48b878c7-cc74-4921-8903-20b748a144a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:50 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.286s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:50 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Deleted volume successfully.
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-quobyte-48b878c7-cc74-4921-8903-20b748a144a5" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-de6e8507-07b6-4a73-a2a5-ac0b7ca41ddb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-6903fe72-5cf0-4390-bfaa-b1d820a12d00-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-48b878c7-cc74-4921-8903-20b748a144a5" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09117a-9684-419e-8293-57a27fd3b92e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:51 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5
Sep 11 06:31:51 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:51 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5" returned: 0 in 0.396s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:51 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5
Sep 11 06:31:51 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:51 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-48b878c7-cc74-4921-8903-20b748a144a5" returned: 0 in 0.247s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-48b878c7-cc74-4921-8903-20b748a144a5" released by "delete_volume" :: held 0.683s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created reservations ['59047fd1-daaa-40f2-a3cb-00de81d897cf', 'd98dc0c9-3926-4b24-9ba9-46eede343157', 'da332e30-8806-43e5-bcf9-9fa0430a27cc', '941abe66-29c2-4a62-aa06-6d3e49ba2476'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:51 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:51 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-3a406369-537b-40d3-8a12-1c64d329c223-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:52 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.287s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Deleted volume successfully.
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-3a406369-537b-40d3-8a12-1c64d329c223-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-da7a0f81-160f-4e9f-9abc-71f3e765e8eb tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-48b878c7-cc74-4921-8903-20b748a144a5-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-quobyte-3a406369-537b-40d3-8a12-1c64d329c223" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-3a406369-537b-40d3-8a12-1c64d329c223" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[89335545-53eb-429a-bd87-7d55aa0787df]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:52 devstack sudo[104994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223
Sep 11 06:31:52 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:52 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223" returned: 0 in 0.387s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:52 devstack sudo[104999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223
Sep 11 06:31:52 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:52 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-3a406369-537b-40d3-8a12-1c64d329c223" returned: 0 in 0.250s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-3a406369-537b-40d3-8a12-1c64d329c223" released by "delete_volume" :: held 0.675s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created reservations ['efb783e7-c2d5-4e85-ad4f-97d0acb6798f', '14226c75-b90d-4e2d-9516-722a2ae9e351', '4cc329cc-8cce-4c64-851b-551d39044a7f', '1abd48ad-0c13-40d6-a400-c7202e59895f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:52 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:52 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:53 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.259s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Deleted volume successfully.
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4eaac47e-521c-47e2-aa5d-df42f5e09dc2 tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-3a406369-537b-40d3-8a12-1c64d329c223-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-315f2b34-613d-4186-97f9-7ef4954f5126-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-315f2b34-613d-4186-97f9-7ef4954f5126-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "cinder-quobyte-315f2b34-613d-4186-97f9-7ef4954f5126" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-315f2b34-613d-4186-97f9-7ef4954f5126" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b4ae30-353c-44b0-827f-4b68943d38e8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:53 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126
Sep 11 06:31:53 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:53 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126" returned: 0 in 0.425s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:53 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126
Sep 11 06:31:53 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:54 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-315f2b34-613d-4186-97f9-7ef4954f5126" returned: 0 in 0.269s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-quobyte-315f2b34-613d-4186-97f9-7ef4954f5126" released by "delete_volume" :: held 0.740s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Created reservations ['c6ec9b5a-a835-48a3-8872-d64ce448353e', '03f6f85d-ff2f-4292-aefb-8c3a3bbae16a', 'edd324d8-965b-4356-9aac-6c99b909627b', 'afa42d3f-fcd7-4cd5-9304-1e3a4afa755a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:54 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:31:54 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:54 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:31:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Deleted volume successfully.
Sep 11 06:31:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-93cb018d-8c2b-4ef3-b4d1-0134e82d5f0f tempest-CreateVolumesFromSourceVolumeTest-586950922 None] Lock "cinder-315f2b34-613d-4186-97f9-7ef4954f5126-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Flow 'volume_create_manager' (3e9bda06-a42a-4975-a8e0-feb2bb3ea84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e360b417-6104-4fa3-97da-4f5a84de1fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e360b417-6104-4fa3-97da-4f5a84de1fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebee8f54-125b-4458-86b8-10678ac4ca48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444ff8142a64905ac49b0715ca49446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:58Z,use_quota=True,user_id='cd732d7a38114cf8985d6d70b489cd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c722487-16fb-4bd5-9014-35d3a6769d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c722487-16fb-4bd5-9014-35d3a6769d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3510748d-ee34-4381-9ea8-96f2f0045653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3510748d-ee34-4381-9ea8-96f2f0045653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebee8f54-125b-4458-86b8-10678ac4ca48', 'volume_name': 'volume-ebee8f54-125b-4458-86b8-10678ac4ca48', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed055222-1e3f-441f-830b-ceb2e59452a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed055222-1e3f-441f-830b-ceb2e59452a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e674cfe5-dd1f-4313-8b56-22223509d9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:58 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Volume ebee8f54-125b-4458-86b8-10678ac4ca48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebee8f54-125b-4458-86b8-10678ac4ca48', 'volume_size': 1}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebee8f54-125b-4458-86b8-10678ac4ca48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444ff8142a64905ac49b0715ca49446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:58Z,use_quota=True,user_id='cd732d7a38114cf8985d6d70b489cd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Creating volume ebee8f54-125b-4458-86b8-10678ac4ca48 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:58 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:58 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48 1073741824
Sep 11 06:31:58 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:58 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48 1073741824" returned: 0 in 0.429s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:58 devstack sudo[105025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48
Sep 11 06:31:58 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:31:58 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48" returned: 0 in 0.260s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e674cfe5-dd1f-4313-8b56-22223509d9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebee8f54-125b-4458-86b8-10678ac4ca48', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0a28cc-526d-4290-8bd6-4445f9765120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:58 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Volume volume-ebee8f54-125b-4458-86b8-10678ac4ca48 (ebee8f54-125b-4458-86b8-10678ac4ca48): created successfully
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0a28cc-526d-4290-8bd6-4445f9765120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Flow 'volume_create_manager' (3e9bda06-a42a-4975-a8e0-feb2bb3ea84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:58 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-16209d3d-65cf-4aef-b1e3-84f6983e4bf5 tempest-CinderUnicodeTest-113069535 None] Created volume successfully.
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Flow 'volume_create_manager' (91efa880-5c25-44d3-9de7-5d53d3a029d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e2e565-7562-4367-a9a2-846084a62b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e2e565-7562-4367-a9a2-846084a62b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1895402042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c526442-e6b5-4a9b-8975-6bc067ec91de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444ff8142a64905ac49b0715ca49446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:59Z,use_quota=True,user_id='cd732d7a38114cf8985d6d70b489cd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99926bd-029a-4892-9582-59bc65fe76cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99926bd-029a-4892-9582-59bc65fe76cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe8746b-d2fb-4888-a5f4-3b21048ea771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe8746b-d2fb-4888-a5f4-3b21048ea771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c526442-e6b5-4a9b-8975-6bc067ec91de', 'volume_name': 'volume-5c526442-e6b5-4a9b-8975-6bc067ec91de', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36155492-b385-4568-80e4-d93b9ff572f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36155492-b385-4568-80e4-d93b9ff572f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96d775e-5c5e-445c-9dec-aada7238f7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:31:59 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Volume 5c526442-e6b5-4a9b-8975-6bc067ec91de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c526442-e6b5-4a9b-8975-6bc067ec91de', 'volume_size': 1}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:31:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1895402042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c526442-e6b5-4a9b-8975-6bc067ec91de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444ff8142a64905ac49b0715ca49446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:31:59Z,use_quota=True,user_id='cd732d7a38114cf8985d6d70b489cd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Creating volume 5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:31:59 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:31:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:31:59 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de 1073741824
Sep 11 06:31:59 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:00 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de 1073741824" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:00 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de
Sep 11 06:32:00 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:00 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de" returned: 0 in 0.238s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96d775e-5c5e-445c-9dec-aada7238f7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c526442-e6b5-4a9b-8975-6bc067ec91de', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9becb855-d2b8-46e6-ac05-85d03e073516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:00 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Volume volume-5c526442-e6b5-4a9b-8975-6bc067ec91de (5c526442-e6b5-4a9b-8975-6bc067ec91de): created successfully
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9becb855-d2b8-46e6-ac05-85d03e073516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Flow 'volume_create_manager' (91efa880-5c25-44d3-9de7-5d53d3a029d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:00 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-70e37c5a-3059-4315-8d31-2b93d02ace8d tempest-CinderUnicodeTest-113069535 None] Created volume successfully.
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Creating offline snapshot d5756100-4208-447e-853c-bd63dc62df52 of volume 5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece9e80-4632-4c30-a2cc-68922d7920ce]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:00 devstack sudo[105036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de
Sep 11 06:32:00 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:01 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de" returned: 0 in 0.360s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:01 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 1G
Sep 11 06:32:01 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:01 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 1G" returned: 0 in 0.384s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c526442-e6b5-4a9b-8975-6bc067ec91de -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:01 devstack sudo[105046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c526442-e6b5-4a9b-8975-6bc067ec91de -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52
Sep 11 06:32:01 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:01 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c526442-e6b5-4a9b-8975-6bc067ec91de -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52" returned: 0 in 0.302s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:01 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 is being set with open permissions: ugo+rw
Sep 11 06:32:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:01 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52
Sep 11 06:32:01 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:02 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52" returned: 0 in 0.245s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:02 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.info
Sep 11 06:32:02 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:02 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.info" returned: 0 in 0.249s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:02 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.info is being set with open permissions: ugo+rw
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:02 devstack sudo[105057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.info
Sep 11 06:32:02 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:02 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.info" returned: 0 in 0.242s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:02 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9cd24cf5-1c25-4da3-8279-96d2b7072096 tempest-CinderUnicodeTest-113069535 None] Create snapshot completed successfully
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "cinder-d5756100-4208-447e-853c-bd63dc62df52-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-d5756100-4208-447e-853c-bd63dc62df52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "cinder-quobyte-5c526442-e6b5-4a9b-8975-6bc067ec91de" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-5c526442-e6b5-4a9b-8975-6bc067ec91de" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "cinder-quobyte-d5756100-4208-447e-853c-bd63dc62df52" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-d5756100-4208-447e-853c-bd63dc62df52" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Deleting offline snapshot d5756100-4208-447e-853c-bd63dc62df52 of volume 5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] snapshot_file for this snap is: volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba421c65-4b96-4592-85a5-ad8ad5bd4e31]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:03 devstack sudo[105060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52
Sep 11 06:32:03 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:03 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c526442-e6b5-4a9b-8975-6bc067ec91de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:32:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0881ce4-c352-4c61-b595-e35115e60e2d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:03 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de
Sep 11 06:32:03 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:03 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:03 devstack sudo[105071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52
Sep 11 06:32:03 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:04 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52" returned: 0 in 0.331s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:04 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52
Sep 11 06:32:04 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:04 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de.d5756100-4208-447e-853c-bd63dc62df52" returned: 0 in 0.245s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-d5756100-4208-447e-853c-bd63dc62df52" released by "_delete_snapshot" :: held 1.400s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-5c526442-e6b5-4a9b-8975-6bc067ec91de" released by "delete_snapshot" :: held 1.425s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:04 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Created reservations ['c14ea48d-032c-4712-a562-e8095d64723e', 'f0d11a89-b03e-44cb-8139-d5842c3a85a1', 'a9bc62ef-6712-4160-9c2b-3ba91c7437ee', 'e1a17cc1-5a18-4fcd-8891-a9520891cd3f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Delete snapshot completed successfully.
Sep 11 06:32:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-004aa8bb-528c-4e10-963c-a8f882fd4893 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-d5756100-4208-447e-853c-bd63dc62df52-delete_snapshot" released by "delete_snapshot" :: held 1.571s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "cinder-5c526442-e6b5-4a9b-8975-6bc067ec91de-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-5c526442-e6b5-4a9b-8975-6bc067ec91de-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "cinder-quobyte-5c526442-e6b5-4a9b-8975-6bc067ec91de" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-5c526442-e6b5-4a9b-8975-6bc067ec91de" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7d94ed-984f-4ba4-aa2c-f821748391ad]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:05 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de
Sep 11 06:32:05 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:05 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de" returned: 0 in 0.364s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:05 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de
Sep 11 06:32:05 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:06 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5c526442-e6b5-4a9b-8975-6bc067ec91de" returned: 0 in 0.245s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-5c526442-e6b5-4a9b-8975-6bc067ec91de" released by "delete_volume" :: held 0.665s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Created reservations ['48ec5490-eb45-43b8-874e-4b66a1deaf0b', '49db9e7c-3f72-470e-aacc-9f48030aa59b', '46951fa3-8e15-475e-adfb-08cb028ed80c', '504cd54a-2e7f-4e9b-a2f7-97643d19766a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:06 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:06 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:06 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.255s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Deleted volume successfully.
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c85c379-c557-481b-a0af-75ec5881d987 tempest-CinderUnicodeTest-113069535 None] Lock "cinder-5c526442-e6b5-4a9b-8975-6bc067ec91de-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Acquiring lock "cinder-ebee8f54-125b-4458-86b8-10678ac4ca48-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Lock "cinder-ebee8f54-125b-4458-86b8-10678ac4ca48-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Acquiring lock "cinder-quobyte-ebee8f54-125b-4458-86b8-10678ac4ca48" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-ebee8f54-125b-4458-86b8-10678ac4ca48" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa120ef-b714-4a50-a4f6-5d9a6c810d3a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:06 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48
Sep 11 06:32:06 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:06 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48" returned: 0 in 0.403s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:06 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48
Sep 11 06:32:06 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:07 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ebee8f54-125b-4458-86b8-10678ac4ca48" returned: 0 in 0.251s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Lock "cinder-quobyte-ebee8f54-125b-4458-86b8-10678ac4ca48" released by "delete_volume" :: held 0.693s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Created reservations ['7deda809-f0ea-4673-8d70-fd5ebaa5f707', '858f92c0-0aab-4182-9035-30b810ef5052', '73f547f2-4351-46db-947b-d016a1c50466', '9274619e-11d4-4fc6-9656-f4267305db41'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:07 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:07 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:07 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.242s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Deleted volume successfully.
Sep 11 06:32:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8eb41d47-d498-4268-9192-4dc1dbee813b tempest-CinderUnicodeTest-113069535 None] Lock "cinder-ebee8f54-125b-4458-86b8-10678ac4ca48-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Flow 'volume_create_manager' (10adc4c3-9e51-41de-951f-9e13819b1695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f836b1-de3d-4044-b5e3-9dcdbbba9306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f836b1-de3d-4044-b5e3-9dcdbbba9306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722215767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13fb4ad-d205-4d52-8306-0de109c567d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0fba2894444b3807d7de4e56d3da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:11Z,use_quota=True,user_id='db5f0bb767d84dc9bfee7b3a48b54cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b620024-d0c9-4d09-8eea-680338a76dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b620024-d0c9-4d09-8eea-680338a76dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2eccf72-627e-4290-adcf-a4f415da733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2eccf72-627e-4290-adcf-a4f415da733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd13fb4ad-d205-4d52-8306-0de109c567d1', 'volume_name': 'volume-d13fb4ad-d205-4d52-8306-0de109c567d1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701a99ee-420b-4e0a-9a66-a32a5b365af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701a99ee-420b-4e0a-9a66-a32a5b365af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3f3cf3-5c12-4a1b-95d6-0a2b1fb40cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Volume d13fb4ad-d205-4d52-8306-0de109c567d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d13fb4ad-d205-4d52-8306-0de109c567d1', 'volume_size': 1}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722215767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13fb4ad-d205-4d52-8306-0de109c567d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0fba2894444b3807d7de4e56d3da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:11Z,use_quota=True,user_id='db5f0bb767d84dc9bfee7b3a48b54cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Creating volume d13fb4ad-d205-4d52-8306-0de109c567d1 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:10 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:10 devstack sudo[105102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1 1073741824
Sep 11 06:32:10 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:11 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1 1073741824" returned: 0 in 0.396s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:11 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1
Sep 11 06:32:11 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:11 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1" returned: 0 in 0.240s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3f3cf3-5c12-4a1b-95d6-0a2b1fb40cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d13fb4ad-d205-4d52-8306-0de109c567d1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e473c9-7605-4637-8c45-c734fb949eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:11 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Volume volume-d13fb4ad-d205-4d52-8306-0de109c567d1 (d13fb4ad-d205-4d52-8306-0de109c567d1): created successfully
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e473c9-7605-4637-8c45-c734fb949eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Flow 'volume_create_manager' (10adc4c3-9e51-41de-951f-9e13819b1695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-bce20cba-409e-4fa3-88bc-d1c9318e8e74 tempest-ProjectReaderTests-965455466 None] Created volume successfully.
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Acquiring lock "cinder-d13fb4ad-d205-4d52-8306-0de109c567d1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Lock "cinder-d13fb4ad-d205-4d52-8306-0de109c567d1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Acquiring lock "cinder-quobyte-d13fb4ad-d205-4d52-8306-0de109c567d1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Lock "cinder-quobyte-d13fb4ad-d205-4d52-8306-0de109c567d1" acquired by "delete_volume" :: waited 0.014s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70fb5ce-f050-4599-842b-e5f1eb0b00a4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:12 devstack sudo[105110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1
Sep 11 06:32:12 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:12 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1" returned: 0 in 0.348s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:12 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1
Sep 11 06:32:12 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:12 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-d13fb4ad-d205-4d52-8306-0de109c567d1" returned: 0 in 0.239s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Lock "cinder-quobyte-d13fb4ad-d205-4d52-8306-0de109c567d1" released by "delete_volume" :: held 0.625s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Created reservations ['da5e4485-dbf5-4306-8818-090f02774bd8', '24afb560-1e89-442b-8abe-ee6d77fe4db1', '1cdfa94e-282b-4a74-a331-f42479a28ddd', '8b94c011-a6e5-4b28-a93e-351a20e1bdb8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:12 devstack sudo[105118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:12 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:13 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.239s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Deleted volume successfully.
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b1d3c40-656f-47d3-9e97-c70ac03a7791 tempest-ProjectReaderTests-965455466 None] Lock "cinder-d13fb4ad-d205-4d52-8306-0de109c567d1-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Flow 'volume_create_manager' (6c87fd2f-33b1-4b3d-9099-b33276b998a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3e5c31-3556-4fd7-b3e9-03dea810e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3e5c31-3556-4fd7-b3e9-03dea810e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321684387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b2923b-4483-4bc4-bc5f-85df1beb5c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0fba2894444b3807d7de4e56d3da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:14Z,use_quota=True,user_id='db5f0bb767d84dc9bfee7b3a48b54cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe47eed-fceb-4427-bc89-5b2846d108fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe47eed-fceb-4427-bc89-5b2846d108fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e2b775-5e07-434c-863d-6a0c0c916ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e2b775-5e07-434c-863d-6a0c0c916ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b2923b-4483-4bc4-bc5f-85df1beb5c7f', 'volume_name': 'volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3d3ff3-28db-4f61-b844-95868ce909d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3d3ff3-28db-4f61-b844-95868ce909d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede37a7f-7177-4863-abea-e6d000935396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Volume f7b2923b-4483-4bc4-bc5f-85df1beb5c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f', 'volume_size': 1}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321684387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b2923b-4483-4bc4-bc5f-85df1beb5c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a0fba2894444b3807d7de4e56d3da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:14Z,use_quota=True,user_id='db5f0bb767d84dc9bfee7b3a48b54cdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Creating volume f7b2923b-4483-4bc4-bc5f-85df1beb5c7f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:13 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:13 devstack sudo[105121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f 1073741824
Sep 11 06:32:13 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:14 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f 1073741824" returned: 0 in 0.410s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:14 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f
Sep 11 06:32:14 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:14 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f" returned: 0 in 0.236s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede37a7f-7177-4863-abea-e6d000935396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfd264c-6fa9-4c36-9cb4-97a19428f715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:14 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Volume volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f (f7b2923b-4483-4bc4-bc5f-85df1beb5c7f): created successfully
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfd264c-6fa9-4c36-9cb4-97a19428f715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Flow 'volume_create_manager' (6c87fd2f-33b1-4b3d-9099-b33276b998a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b62365d3-26c3-4b07-a456-e4d7031ea635 tempest-ProjectReaderTests-965455466 None] Created volume successfully.
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Acquiring lock "cinder-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Lock "cinder-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Acquiring lock "cinder-quobyte-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Lock "cinder-quobyte-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4faff5-dad7-440c-b741-2996ef26b3af]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:14 devstack sudo[105129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f
Sep 11 06:32:14 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:15 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:15 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f
Sep 11 06:32:15 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:15 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f" returned: 0 in 0.248s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Lock "cinder-quobyte-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f" released by "delete_volume" :: held 0.645s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Created reservations ['db051b77-5590-4b37-986b-2a83556dff71', '327305e2-d6ec-42bc-b38c-ed652f4afa5b', 'ca25f839-c632-4383-ad25-91891414f9ea', 'e9d17fca-6cae-4b08-9694-a93e6487b1e0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:15 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:15 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:15 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.247s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:15 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Deleted volume successfully.
Sep 11 06:32:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-99c29036-056d-4847-9064-c62775d4af34 tempest-ProjectReaderTests-965455466 None] Lock "cinder-f7b2923b-4483-4bc4-bc5f-85df1beb5c7f-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:25 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=142,cinder:SELECT=94,cinder:DELETE=13,cinder:INSERT=31 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:32:25 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=96,cinder:INSERT=37,cinder:UPDATE=139,cinder:DELETE=11 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (f787589c-844b-43f9-a2bd-c457102dad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d70cda4-9827-4bb5-8620-1d5a828213bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d70cda4-9827-4bb5-8620-1d5a828213bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465982737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f3486e-fa06-4b55-88ad-9ef573bf94f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:28Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4c7d52-473f-4f41-a03e-5f699a69f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4c7d52-473f-4f41-a03e-5f699a69f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef9ff17-5827-420a-a9e8-6cfcdfc98a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef9ff17-5827-420a-a9e8-6cfcdfc98a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f3486e-fa06-4b55-88ad-9ef573bf94f7', 'volume_name': 'volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e768c3-1644-4a0c-96c6-74b5e68b2c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e768c3-1644-4a0c-96c6-74b5e68b2c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fff160-f672-43de-92ef-9945957b4025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume 34f3486e-fa06-4b55-88ad-9ef573bf94f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7', 'volume_size': 1}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465982737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f3486e-fa06-4b55-88ad-9ef573bf94f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:28Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Creating volume 34f3486e-fa06-4b55-88ad-9ef573bf94f7 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:27 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:27 devstack sudo[105178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7 1073741824
Sep 11 06:32:27 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (d0156b3f-d762-4aca-81cd-e64c9cb4d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4417745-76af-400e-8ab2-359875827400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4417745-76af-400e-8ab2-359875827400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776047969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560ee0af-7aa4-462e-bcfc-e572dd0356a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:28Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a35ef4-6ff3-4a74-a022-70041185b51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a35ef4-6ff3-4a74-a022-70041185b51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7217c6-bffc-4b5c-bc9a-23c8c1967af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7217c6-bffc-4b5c-bc9a-23c8c1967af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560ee0af-7aa4-462e-bcfc-e572dd0356a8', 'volume_name': 'volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:27 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4703041-6247-430e-8c89-05c7667889bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4703041-6247-430e-8c89-05c7667889bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013df7d3-18a1-478e-ad13-5dd30c900b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:28 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume 560ee0af-7aa4-462e-bcfc-e572dd0356a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8', 'volume_size': 1}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:28 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7 1073741824" returned: 0 in 0.548s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:28 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7
Sep 11 06:32:28 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:28 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7" returned: 0 in 0.272s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776047969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560ee0af-7aa4-462e-bcfc-e572dd0356a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:28Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Creating volume 560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:28 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fff160-f672-43de-92ef-9945957b4025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c09fc5-c830-42ee-b21a-707ac98c7909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:28 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 1073741824
Sep 11 06:32:28 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:28 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7 (34f3486e-fa06-4b55-88ad-9ef573bf94f7): created successfully
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c09fc5-c830-42ee-b21a-707ac98c7909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:28 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (f787589c-844b-43f9-a2bd-c457102dad6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ca0a8952-a438-4564-9a20-6d2360007383 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created volume successfully.
Sep 11 06:32:29 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 1073741824" returned: 0 in 0.533s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:29 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8
Sep 11 06:32:29 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:29 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8" returned: 0 in 0.303s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013df7d3-18a1-478e-ad13-5dd30c900b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c43477-7ca7-46e3-adbd-8a7567b3acd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:29 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 (560ee0af-7aa4-462e-bcfc-e572dd0356a8): created successfully
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c43477-7ca7-46e3-adbd-8a7567b3acd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:29 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (d0156b3f-d762-4aca-81cd-e64c9cb4d51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5e5b88eb-6897-446b-9bd6-939fb66f09fa tempest-CreateVolumesFromSnapshotTest-62216531 None] Created volume successfully.
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (54498fda-1f6e-4db1-adb6-4f60e4692b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b01624-f422-46bf-a97e-b74c3e3bb79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b01624-f422-46bf-a97e-b74c3e3bb79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116496613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8154a611-e95a-422f-a55e-c848f925768a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:30Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14160e76-f062-40f4-8b97-f7249d31d865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14160e76-f062-40f4-8b97-f7249d31d865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c4cd0e-d0de-4edf-acff-80b4de5d3c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c4cd0e-d0de-4edf-acff-80b4de5d3c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8154a611-e95a-422f-a55e-c848f925768a', 'volume_name': 'volume-8154a611-e95a-422f-a55e-c848f925768a', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f024ea-49b6-4e5f-b40f-4e1fa93caefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f024ea-49b6-4e5f-b40f-4e1fa93caefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d04da56-c0f3-4297-9ba8-bdb792fcc2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:30 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume 8154a611-e95a-422f-a55e-c848f925768a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8154a611-e95a-422f-a55e-c848f925768a', 'volume_size': 1}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116496613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8154a611-e95a-422f-a55e-c848f925768a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:30Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Creating volume 8154a611-e95a-422f-a55e-c848f925768a {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:30 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:30 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a 1073741824
Sep 11 06:32:30 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Flow 'volume_create_manager' (4fa787cb-5980-4521-a397-c7ea80139e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f638540-9b24-4f49-bd3c-890d42d035ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f638540-9b24-4f49-bd3c-890d42d035ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8357b85f-acd0-44b6-8255-d8e02e13be48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10acb4c1b5e4f00bc49f5a5fa5217e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:31Z,use_quota=True,user_id='c5392ba6f5aa490591c5cbdc5261efc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad37467-7e39-400d-9d65-c36a64daf63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:30 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad37467-7e39-400d-9d65-c36a64daf63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078fbae4-9bef-485a-b92a-10ffbfcd0a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:31 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (9ffd49c0-7eb0-4369-8434-d96f09b49dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f21927-d398-4ff3-ba56-b150a72c4fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a 1073741824" returned: 0 in 0.810s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:31 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:31 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f21927-d398-4ff3-ba56-b150a72c4fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121741683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc54ace9-09d0-4330-8652-0769a9912d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:31Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f286d06-33d7-4f71-98c6-1efb1bc8527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f286d06-33d7-4f71-98c6-1efb1bc8527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50864f2b-5251-4cc4-9b0c-a8667c0a77c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50864f2b-5251-4cc4-9b0c-a8667c0a77c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc54ace9-09d0-4330-8652-0769a9912d89', 'volume_name': 'volume-bc54ace9-09d0-4330-8652-0769a9912d89', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0fbf1e-0862-4e0e-b4ef-978e01cc0c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0fbf1e-0862-4e0e-b4ef-978e01cc0c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db40015-0f8f-42f7-b551-c5a9e48fee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume bc54ace9-09d0-4330-8652-0769a9912d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc54ace9-09d0-4330-8652-0769a9912d89', 'volume_size': 1}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (c7d76bc4-31c9-40b3-a429-9343259f3744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2175fd7-f2cf-4de3-8f0b-d7d4439a17d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:31 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a
Sep 11 06:32:31 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2175fd7-f2cf-4de3-8f0b-d7d4439a17d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146260581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbf430a-697f-4b4f-85f1-311f0a09dad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:31Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbaf563-aed2-4bae-8e3c-8f80f8f2629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbaf563-aed2-4bae-8e3c-8f80f8f2629c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783c7a6a-5ad3-4fb8-8cfb-8a7dfbebc0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783c7a6a-5ad3-4fb8-8cfb-8a7dfbebc0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bbf430a-697f-4b4f-85f1-311f0a09dad7', 'volume_name': 'volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b58ca0-4dd0-4a3b-be16-cf85a94020ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b58ca0-4dd0-4a3b-be16-cf85a94020ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b754a95a-ff9c-4069-8b11-66d2fa69cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume 7bbf430a-697f-4b4f-85f1-311f0a09dad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7', 'volume_size': 1}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.373s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078fbae4-9bef-485a-b92a-10ffbfcd0a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8357b85f-acd0-44b6-8255-d8e02e13be48', 'volume_name': 'volume-8357b85f-acd0-44b6-8255-d8e02e13be48', 'volume_size': 1, 'image_id': 'e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b38675dfc4e8cd850172beaed522c17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b10acb4c1b5e4f00bc49f5a5fa5217e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff08b2fc64f205a850c7fc75a47ac8fcaee2dbab7b6b5d338a7392b2ed527fe50e13935456b08b0e9cdb3e775ea0a3b1249dd89d559c06993ee9fcf9b83d3088', 'id': 'e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'created_at': datetime.datetime(2026, 9, 11, 4, 32, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 32, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030c9ad160>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff684bc5-9451-4bb1-ad13-e88e5ff8ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff684bc5-9451-4bb1-ad13-e88e5ff8ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dd7446-0560-4580-a92b-fcb1bc817d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Volume 8357b85f-acd0-44b6-8255-d8e02e13be48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8357b85f-acd0-44b6-8255-d8e02e13be48', 'volume_size': 1, 'image_id': 'e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b38675dfc4e8cd850172beaed522c17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b10acb4c1b5e4f00bc49f5a5fa5217e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff08b2fc64f205a850c7fc75a47ac8fcaee2dbab7b6b5d338a7392b2ed527fe50e13935456b08b0e9cdb3e775ea0a3b1249dd89d559c06993ee9fcf9b83d3088', 'id': 'e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'created_at': datetime.datetime(2026, 9, 11, 4, 32, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 32, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030c9ad160>}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Trying to clone 8357b85f-acd0-44b6-8255-d8e02e13be48 from image e7011e02-d7d0-449a-9bf5-71c1e54afd78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (a587446d-47f4-4c79-9cee-8f87bb095f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f84302-0c78-4692-817d-93da048f8efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:32:31 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f84302-0c78-4692-817d-93da048f8efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687076083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee44e60-2428-4240-9728-a0af405102ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:32Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc0c10c-9d77-4e5f-936b-d8da9a4f7924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc0c10c-9d77-4e5f-936b-d8da9a4f7924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f57568-e0b1-4fe1-a810-c7150661db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f57568-e0b1-4fe1-a810-c7150661db55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee44e60-2428-4240-9728-a0af405102ed', 'volume_name': 'volume-9ee44e60-2428-4240-9728-a0af405102ed', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b646f1-341b-4709-9d4c-971dadc96bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b646f1-341b-4709-9d4c-971dadc96bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fbf066-43d2-4f4f-8015-8bf561cc5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume 9ee44e60-2428-4240-9728-a0af405102ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee44e60-2428-4240-9728-a0af405102ed', 'volume_size': 1}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:31 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a" returned: 0 in 0.486s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a506484e-8073-4fb6-a7d6-63054d7d38d7]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.101s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Creating offline snapshot 66387a70-4089-439a-8e5e-af45f81ec3c6 of volume 560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d04da56-c0f3-4297-9ba8-bdb792fcc2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8154a611-e95a-422f-a55e-c848f925768a', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d59ee2-614e-4224-bdc5-5440a3466c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8b178a-c20c-4a50-bd5d-fd808bff6540]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume volume-8154a611-e95a-422f-a55e-c848f925768a (8154a611-e95a-422f-a55e-c848f925768a): created successfully
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d59ee2-614e-4224-bdc5-5440a3466c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (54498fda-1f6e-4db1-adb6-4f60e4692b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:32 devstack sudo[105210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD
Sep 11 06:32:32 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:32 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7e1582d3-e4e9-459e-827b-6721b38262ef tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created volume successfully.
Sep 11 06:32:32 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8
Sep 11 06:32:32 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:32 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Flow 'volume_create_manager' (ac524b5a-6c2d-4aeb-8d4e-be509ce20f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5f9b00-be5a-4b63-be17-b3620889a6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5f9b00-be5a-4b63-be17-b3620889a6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab51218-eefd-450a-9e8d-9b03808b5f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3f264856585485591e67f8724d5143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:32Z,use_quota=True,user_id='cbf870865e7a406683d34ace11e9cf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4f2d621-d357-48ec-8787-b274e81101bd),volume_type_id=c4f2d621-d357-48ec-8787-b274e81101bd)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b229a3f-be96-436a-99eb-8bd9f3c14433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD
Sep 11 06:32:32 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b229a3f-be96-436a-99eb-8bd9f3c14433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4202033-2874-4ee8-868f-df0f01c89e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.image.glance [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Creating Keystone auth plugin from conf {{(pid=88109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 06:32:32 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8" returned: 0 in 0.522s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:32 devstack sudo[105225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 1G
Sep 11 06:32:32 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (1e528987-cbf8-48ab-b300-e5c86c8b0e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ae9999-1e64-4e9b-99e6-b666d3954266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ae9999-1e64-4e9b-99e6-b666d3954266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562771416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d3c95a-e975-4001-9e68-97dcd4953a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:33Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4496b9-3ab8-495c-85cc-29c17f306d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4496b9-3ab8-495c-85cc-29c17f306d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ab3692-e70e-4e4c-9a78-2faa4e5467a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ab3692-e70e-4e4c-9a78-2faa4e5467a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d3c95a-e975-4001-9e68-97dcd4953a36', 'volume_name': 'volume-91d3c95a-e975-4001-9e68-97dcd4953a36', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f74792-f1c6-4cd6-9893-76fa36fbecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f74792-f1c6-4cd6-9893-76fa36fbecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a81d22-6c20-44d0-9676-635348eeecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume 91d3c95a-e975-4001-9e68-97dcd4953a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d3c95a-e975-4001-9e68-97dcd4953a36', 'volume_size': 1}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:32 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Temporary image e7011e02-d7d0-449a-9bf5-71c1e54afd78 is fetched for user c5392ba6f5aa490591c5cbdc5261efc2. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4202033-2874-4ee8-868f-df0f01c89e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ab51218-eefd-450a-9e8d-9b03808b5f8f', 'volume_name': 'volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f', 'volume_size': 1, 'image_id': '7160f64b-3495-491e-ae47-b9953491ba3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7160f64b-3495-491e-ae47-b9953491ba3b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ddc276bf80610547bc91bc48d4dfa7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd3f264856585485591e67f8724d5143c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7225254b2878e2ff123d7a2d9e601b6e6b7caf3520bdfb546dbae7f984d1c7f98fc95a9ce68ad17393e63b9ea528f6f0cc887ff0b392506f14944e70723daee', 'id': '7160f64b-3495-491e-ae47-b9953491ba3b', 'created_at': datetime.datetime(2026, 9, 11, 4, 32, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 32, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7160f64b-3495-491e-ae47-b9953491ba3b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316ebdfd0>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95bbd96-4a5e-4d2e-b9d3-0cc897804910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95bbd96-4a5e-4d2e-b9d3-0cc897804910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cb457c-ef18-49bd-9501-3a35060d5305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Volume 8ab51218-eefd-450a-9e8d-9b03808b5f8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f', 'volume_size': 1, 'image_id': '7160f64b-3495-491e-ae47-b9953491ba3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7160f64b-3495-491e-ae47-b9953491ba3b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ddc276bf80610547bc91bc48d4dfa7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd3f264856585485591e67f8724d5143c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7225254b2878e2ff123d7a2d9e601b6e6b7caf3520bdfb546dbae7f984d1c7f98fc95a9ce68ad17393e63b9ea528f6f0cc887ff0b392506f14944e70723daee', 'id': '7160f64b-3495-491e-ae47-b9953491ba3b', 'created_at': datetime.datetime(2026, 9, 11, 4, 32, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 32, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7160f64b-3495-491e-ae47-b9953491ba3b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316ebdfd0>}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Trying to clone 8ab51218-eefd-450a-9e8d-9b03808b5f8f from image 7160f64b-3495-491e-ae47-b9953491ba3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7160f64b-3495-491e-ae47-b9953491ba3b', 'metadata': {}}]). {{(pid=88109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fdf589-4004-48b4-b46a-a04ac2f95e0b]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 11 06:32:32 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 06:32:32 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 1G" returned: 0 in 0.493s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:32 devstack sudo[105233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD
Sep 11 06:32:32 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6
Sep 11 06:32:33 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc295077-1398-4ad6-a41e-941e01dff1aa]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:33 devstack sudo[105238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD
Sep 11 06:32:33 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:33 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6" returned: 0 in 0.352s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:33 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 is being set with open permissions: ugo+rw
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:33 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6
Sep 11 06:32:33 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD
Sep 11 06:32:33 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:33 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD
Sep 11 06:32:33 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:33 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:33 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.info
Sep 11 06:32:33 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Temporary image 7160f64b-3495-491e-ae47-b9953491ba3b is fetched for user cbf870865e7a406683d34ace11e9cf9b. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f6efbb-67c6-44a0-9ff5-3bf2ecb1db05]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:33 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.info" returned: 0 in 0.269s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:33 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.info is being set with open permissions: ugo+rw
Sep 11 06:32:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:33 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.info
Sep 11 06:32:33 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:33 devstack sudo[105264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD
Sep 11 06:32:33 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:34 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.info" returned: 0 in 0.251s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.912s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121741683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc54ace9-09d0-4330-8652-0769a9912d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:31Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Creating volume bc54ace9-09d0-4330-8652-0769a9912d89 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:34 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:34 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:34 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89 1073741824
Sep 11 06:32:34 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f73e89cf-6b61-4993-9d8b-e17b5d1b73cb tempest-CreateVolumesFromSnapshotTest-62216531 None] Create snapshot completed successfully
Sep 11 06:32:34 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD
Sep 11 06:32:34 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:34 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:34 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89 1073741824" returned: 0 in 0.427s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:34 devstack sudo[105296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89
Sep 11 06:32:34 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:34 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89" returned: 0 in 0.252s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.362s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146260581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbf430a-697f-4b4f-85f1-311f0a09dad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:31Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Creating volume 7bbf430a-697f-4b4f-85f1-311f0a09dad7 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:34 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db40015-0f8f-42f7-b551-c5a9e48fee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc54ace9-09d0-4330-8652-0769a9912d89', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:34 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7 1073741824
Sep 11 06:32:34 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1a1b3b-1ccd-4d62-b5c4-cc23f244bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:34 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume volume-bc54ace9-09d0-4330-8652-0769a9912d89 (bc54ace9-09d0-4330-8652-0769a9912d89): created successfully
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1a1b3b-1ccd-4d62-b5c4-cc23f244bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:34 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (9ffd49c0-7eb0-4369-8434-d96f09b49dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:34 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9d479f2d-bf7e-482f-93fc-87c643302cae tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created volume successfully.
Sep 11 06:32:35 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7 1073741824" returned: 0 in 0.425s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:35 devstack sudo[105327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7
Sep 11 06:32:35 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:35 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7" returned: 0 in 0.273s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.804s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687076083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee44e60-2428-4240-9728-a0af405102ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:32Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Creating volume 9ee44e60-2428-4240-9728-a0af405102ed {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:35 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:35 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed 1073741824
Sep 11 06:32:35 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b754a95a-ff9c-4069-8b11-66d2fa69cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c40c391-d0b3-48b6-a28b-455f831c47a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:35 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7 (7bbf430a-697f-4b4f-85f1-311f0a09dad7): created successfully
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c40c391-d0b3-48b6-a28b-455f831c47a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (c7d76bc4-31c9-40b3-a429-9343259f3744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:35 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5a6a0a2a-42b2-4865-bd55-5ce0fdeed0e4 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created volume successfully.
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (f6c36fb4-f037-4920-81a6-3f720118f285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c3c361-33cb-45f0-83ef-4455e5e169e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c3c361-33cb-45f0-83ef-4455e5e169e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470002868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279f77de-b590-4dd2-a577-3049bd3e3ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:36Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b7ebbf-1db0-41a0-89f9-86db93616a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b7ebbf-1db0-41a0-89f9-86db93616a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3186d108-61b9-492b-817a-e9de563301dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3186d108-61b9-492b-817a-e9de563301dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279f77de-b590-4dd2-a577-3049bd3e3ec1', 'volume_name': 'volume-279f77de-b590-4dd2-a577-3049bd3e3ec1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d29bc12-da5c-4cea-90d3-8808dfe8c490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d29bc12-da5c-4cea-90d3-8808dfe8c490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cade3739-cd49-48a0-b0ad-2accef5dddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:35 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume 279f77de-b590-4dd2-a577-3049bd3e3ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279f77de-b590-4dd2-a577-3049bd3e3ec1', 'volume_size': 1}
Sep 11 06:32:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (aadd8135-0fcb-4356-98b9-51aa74487b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc97a8e-1549-4c48-8071-b93bd6e6c729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed 1073741824" returned: 0 in 0.491s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc97a8e-1549-4c48-8071-b93bd6e6c729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121317797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfafe3d-460a-498d-af10-af4e83ebf171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:36Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06244f41-c4d4-4bf4-8e43-545ee0791e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06244f41-c4d4-4bf4-8e43-545ee0791e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb29099-336a-48d4-bb81-a1ac08b2412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb29099-336a-48d4-bb81-a1ac08b2412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfafe3d-460a-498d-af10-af4e83ebf171', 'volume_name': 'volume-2cfafe3d-460a-498d-af10-af4e83ebf171', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb51f6d-952e-4a0c-b17a-1b82667b6388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb51f6d-952e-4a0c-b17a-1b82667b6388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd399ea-af69-4ac6-9b98-d7dea8db97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume 2cfafe3d-460a-498d-af10-af4e83ebf171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfafe3d-460a-498d-af10-af4e83ebf171', 'volume_size': 1}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:36 devstack sudo[105336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed
Sep 11 06:32:36 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (2076ab82-f406-493a-bd5e-9cf43f2b1476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779a64d5-eb13-4185-a4e2-d1db45b6a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779a64d5-eb13-4185-a4e2-d1db45b6a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224754778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa7afc9-a823-48e5-99cc-81851e60f1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:36Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84956e0-d0a9-4404-b311-379d8dc570df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84956e0-d0a9-4404-b311-379d8dc570df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604f36a3-9608-4bad-a6d9-fab24b92188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604f36a3-9608-4bad-a6d9-fab24b92188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa7afc9-a823-48e5-99cc-81851e60f1c9', 'volume_name': 'volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c9252-7787-480b-94bc-f0812814e96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1c9252-7787-480b-94bc-f0812814e96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8fa762-075c-4e2e-b052-d44652c4f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume 5fa7afc9-a823-48e5-99cc-81851e60f1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9', 'volume_size': 1}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed" returned: 0 in 0.315s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.878s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562771416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d3c95a-e975-4001-9e68-97dcd4953a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84ab75bd00ae47d39906f77e9d87a79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:33Z,use_quota=True,user_id='329b88577474441b8fe2b33e31737ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Creating volume 91d3c95a-e975-4001-9e68-97dcd4953a36 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:36 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:36 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36 1073741824
Sep 11 06:32:36 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fbf066-43d2-4f4f-8015-8bf561cc5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee44e60-2428-4240-9728-a0af405102ed', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7e241e-dbaf-4d1d-a348-bcc4cf8bfe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume volume-9ee44e60-2428-4240-9728-a0af405102ed (9ee44e60-2428-4240-9728-a0af405102ed): created successfully
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7e241e-dbaf-4d1d-a348-bcc4cf8bfe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (a587446d-47f4-4c79-9cee-8f87bb095f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9c428318-b465-43e4-b163-39d8040e498d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created volume successfully.
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (e74d68cb-ed65-442a-bfb1-15dbd25e3f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7c403-b3b2-493d-b28b-07b534fcf4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad7c403-b3b2-493d-b28b-07b534fcf4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-578984153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa68317-6f70-4069-bb69-1cc156dd3dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:37Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d61e606-b7da-47bd-95be-805731ebf1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d61e606-b7da-47bd-95be-805731ebf1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711f879-51b1-4b77-a696-4cb7816044c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711f879-51b1-4b77-a696-4cb7816044c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa68317-6f70-4069-bb69-1cc156dd3dbb', 'volume_name': 'volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21559f68-9c74-468e-a206-3a344da32804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21559f68-9c74-468e-a206-3a344da32804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcfb8f7-13e4-4348-87a3-fc47afba4fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:36 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume 6aa68317-6f70-4069-bb69-1cc156dd3dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb', 'volume_size': 1}
Sep 11 06:32:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:37 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36 1073741824" returned: 0 in 0.535s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:37 devstack sudo[105345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36
Sep 11 06:32:37 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (f8d0801c-39d5-4050-91e7-f01951d0c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec3dd24-f15e-4dd2-8894-7fca7d7fa1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec3dd24-f15e-4dd2-8894-7fca7d7fa1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589568902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c8a1d2-2dce-4e75-8ac5-84813254d587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:37Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84ed5ae-5337-47d3-bff3-a80af2e8cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84ed5ae-5337-47d3-bff3-a80af2e8cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c37f12-a0f7-4659-a0d1-671e474651e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c37f12-a0f7-4659-a0d1-671e474651e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c8a1d2-2dce-4e75-8ac5-84813254d587', 'volume_name': 'volume-76c8a1d2-2dce-4e75-8ac5-84813254d587', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1641b773-dd62-4231-84d8-72537ffd9ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1641b773-dd62-4231-84d8-72537ffd9ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a526b208-c031-41c5-8235-82e5bc545374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:37 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume 76c8a1d2-2dce-4e75-8ac5-84813254d587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c8a1d2-2dce-4e75-8ac5-84813254d587', 'volume_size': 1}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:37 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36" returned: 0 in 0.247s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.780s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8357b85f-acd0-44b6-8255-d8e02e13be48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10acb4c1b5e4f00bc49f5a5fa5217e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:31Z,use_quota=True,user_id='c5392ba6f5aa490591c5cbdc5261efc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Creating volume 8357b85f-acd0-44b6-8255-d8e02e13be48 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:37 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a81d22-6c20-44d0-9676-635348eeecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d3c95a-e975-4001-9e68-97dcd4953a36', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:37 devstack sudo[105348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 1073741824
Sep 11 06:32:37 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c89789b-628b-4e1d-aa33-e86d3c71ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:37 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Volume volume-91d3c95a-e975-4001-9e68-97dcd4953a36 (91d3c95a-e975-4001-9e68-97dcd4953a36): created successfully
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c89789b-628b-4e1d-aa33-e86d3c71ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Flow 'volume_create_manager' (1e528987-cbf8-48ab-b300-e5c86c8b0e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:37 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-71f68bef-2f5e-4a5b-8b90-ac49611478c9 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created volume successfully.
Sep 11 06:32:37 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 1073741824" returned: 0 in 0.417s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:37 devstack sudo[105353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48
Sep 11 06:32:37 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-91d3c95a-e975-4001-9e68-97dcd4953a36-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-91d3c95a-e975-4001-9e68-97dcd4953a36-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-quobyte-91d3c95a-e975-4001-9e68-97dcd4953a36" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-91d3c95a-e975-4001-9e68-97dcd4953a36" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f5ba35-abda-4214-a3f0-b7c3114104de]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:38 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36
Sep 11 06:32:38 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:38 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48" returned: 0 in 0.268s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.568s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab51218-eefd-450a-9e8d-9b03808b5f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3f264856585485591e67f8724d5143c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:32Z,use_quota=True,user_id='cbf870865e7a406683d34ace11e9cf9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4f2d621-d357-48ec-8787-b274e81101bd),volume_type_id=c4f2d621-d357-48ec-8787-b274e81101bd)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Creating volume 8ab51218-eefd-450a-9e8d-9b03808b5f8f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:38 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Attempting download of e7011e02-d7d0-449a-9bf5-71c1e54afd78 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'metadata': {}}])) to volume 8357b85f-acd0-44b6-8255-d8e02e13be48. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:32:38 devstack sudo[105358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f 1073741824
Sep 11 06:32:38 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[03012008-4134-4269-baf7-98706c1459eb]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7011e02-d7d0-449a-9bf5-71c1e54afd78__oagct50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:38 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36" returned: 0 in 0.369s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:38 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7011e02-d7d0-449a-9bf5-71c1e54afd78__oagct50
Sep 11 06:32:38 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:38 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36
Sep 11 06:32:38 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:38 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7011e02-d7d0-449a-9bf5-71c1e54afd78__oagct50" returned: 0 in 0.378s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:38 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7011e02-d7d0-449a-9bf5-71c1e54afd78__oagct50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:38 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f 1073741824" returned: 0 in 0.488s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-91d3c95a-e975-4001-9e68-97dcd4953a36" returned: 0 in 0.284s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-91d3c95a-e975-4001-9e68-97dcd4953a36" released by "delete_volume" :: held 0.708s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:38 devstack sudo[105377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f
Sep 11 06:32:38 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created reservations ['2a7f6d0b-35a6-45e6-ae4b-134076c7e155', 'a7ea7aa7-9905-4f47-9210-7725f4230945', 'dd98fd07-9c8d-4bca-ae34-1b21c0634725', 'ee415a14-42fe-490e-98aa-84c80db925ae'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:38 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7011e02-d7d0-449a-9bf5-71c1e54afd78__oagct50
Sep 11 06:32:38 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:38 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:38 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:38 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f" returned: 0 in 0.268s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.052s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470002868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279f77de-b590-4dd2-a577-3049bd3e3ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:36Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Creating volume 279f77de-b590-4dd2-a577-3049bd3e3ec1 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:38 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7011e02-d7d0-449a-9bf5-71c1e54afd78__oagct50" returned: 1 in 0.413s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7011e02-d7d0-449a-9bf5-71c1e54afd78__oagct50' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:39 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1 1073741824
Sep 11 06:32:39 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1e1266-1f92-4352-9799-242ea616435c]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Attempting download of 7160f64b-3495-491e-ae47-b9953491ba3b ((None, [{'url': 'file:///opt/stack/data/glance/images/7160f64b-3495-491e-ae47-b9953491ba3b', 'metadata': {}}])) to volume 8ab51218-eefd-450a-9e8d-9b03808b5f8f. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-9ee44e60-2428-4240-9728-a0af405102ed-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-9ee44e60-2428-4240-9728-a0af405102ed-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:39 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.323s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff0297-f872-4031-8b60-b0126f6db764]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7160f64b-3495-491e-ae47-b9953491ba3b_9k658snh {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Deleted volume successfully.
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-quobyte-9ee44e60-2428-4240-9728-a0af405102ed" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:39 devstack sudo[105388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD
Sep 11 06:32:39 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-9ee44e60-2428-4240-9728-a0af405102ed" acquired by "delete_volume" :: waited 0.035s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-31995d14-0cdb-4dd0-9388-222ceabf3f4e tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-91d3c95a-e975-4001-9e68-97dcd4953a36-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb253dbe-641a-4f78-a3fb-fe7f219b719b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7160f64b-3495-491e-ae47-b9953491ba3b_9k658snh
Sep 11 06:32:39 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed
Sep 11 06:32:39 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1 1073741824" returned: 0 in 0.506s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1
Sep 11 06:32:39 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7160f64b-3495-491e-ae47-b9953491ba3b_9k658snh" returned: 0 in 0.440s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7160f64b-3495-491e-ae47-b9953491ba3b_9k658snh {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack sudo[105400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD
Sep 11 06:32:39 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed" returned: 0 in 0.470s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7160f64b-3495-491e-ae47-b9953491ba3b_9k658snh
Sep 11 06:32:39 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed
Sep 11 06:32:39 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1" returned: 0 in 0.306s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.639s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121317797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfafe3d-460a-498d-af10-af4e83ebf171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:36Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Creating volume 2cfafe3d-460a-498d-af10-af4e83ebf171 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:39 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cade3739-cd49-48a0-b0ad-2accef5dddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279f77de-b590-4dd2-a577-3049bd3e3ec1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:39 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171 1073741824
Sep 11 06:32:39 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c21ea4a-79a9-4e5c-9950-423f8887dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] e7011e02-d7d0-449a-9bf5-71c1e54afd78 was raw, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:39 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume volume-279f77de-b590-4dd2-a577-3049bd3e3ec1 (279f77de-b590-4dd2-a577-3049bd3e3ec1): created successfully
Sep 11 06:32:39 devstack sudo[105419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c21ea4a-79a9-4e5c-9950-423f8887dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:39 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (f6c36fb4-f037-4920-81a6-3f720118f285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9d95f061-54c2-438b-901a-3b015c561895 tempest-CreateVolumesFromSnapshotTest-62216531 None] Created volume successfully.
Sep 11 06:32:40 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7160f64b-3495-491e-ae47-b9953491ba3b_9k658snh" returned: 1 in 0.428s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7160f64b-3495-491e-ae47-b9953491ba3b_9k658snh' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0286b353-7edc-4d2a-9b1c-0cc1d65c6c98]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:40 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-9ee44e60-2428-4240-9728-a0af405102ed" returned: 0 in 0.357s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-9ee44e60-2428-4240-9728-a0af405102ed" released by "delete_volume" :: held 0.905s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:40 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD
Sep 11 06:32:40 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created reservations ['798046f3-c84e-49cc-ba26-474971bb3303', 'f3ac08f3-4c82-44fb-953a-6610cc52561f', '8dda8159-76ca-40a6-a6ec-8783c2b77746', '8588d003-e7c4-453f-baa6-4854d47dc907'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:40 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:40 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:40 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171 1073741824" returned: 0 in 0.588s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:40 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48" returned: 0 in 0.619s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7011e02-d7d0-449a-9bf5-71c1e54afd78_k_owdvjhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:32:40 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:40 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171
Sep 11 06:32:40 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:40 devstack sudo[105442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 1G
Sep 11 06:32:40 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:40 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD
Sep 11 06:32:40 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:40 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.291s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Deleted volume successfully.
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e64bd711-6c79-4080-be3a-b2756d44527c tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-9ee44e60-2428-4240-9728-a0af405102ed-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:40 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171" returned: 0 in 0.321s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:40 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.285s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224754778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa7afc9-a823-48e5-99cc-81851e60f1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:36Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Creating volume 5fa7afc9-a823-48e5-99cc-81851e60f1c9 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:40 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD' failed. Not Retrying. {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] 7160f64b-3495-491e-ae47-b9953491ba3b was raw, converting to qcow2 {{(pid=88109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:40 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9 1073741824
Sep 11 06:32:40 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:40 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd399ea-af69-4ac6-9b98-d7dea8db97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfafe3d-460a-498d-af10-af4e83ebf171', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:40 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a47c6a-a961-45ab-ab37-0811884f4160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:40 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 1G" returned: 0 in 0.377s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Downloaded image e7011e02-d7d0-449a-9bf5-71c1e54afd78 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'metadata': {}}])) to volume 8357b85f-acd0-44b6-8255-d8e02e13be48 successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Temporary image e7011e02-d7d0-449a-9bf5-71c1e54afd78 for user c5392ba6f5aa490591c5cbdc5261efc2 is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Marking volume 8357b85f-acd0-44b6-8255-d8e02e13be48 as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:32:40 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume volume-2cfafe3d-460a-498d-af10-af4e83ebf171 (2cfafe3d-460a-498d-af10-af4e83ebf171): created successfully
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a47c6a-a961-45ab-ab37-0811884f4160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (aadd8135-0fcb-4356-98b9-51aa74487b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Copying metadata from image e7011e02-d7d0-449a-9bf5-71c1e54afd78 to 8357b85f-acd0-44b6-8255-d8e02e13be48. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:32:40 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Creating volume glance metadata for volume 8357b85f-acd0-44b6-8255-d8e02e13be48 backed by image e7011e02-d7d0-449a-9bf5-71c1e54afd78 with: {'image_id': 'e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3b38675dfc4e8cd850172beaed522c17', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:32:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e760bb6b-0550-4541-9827-a77b56e3c26f tempest-CreateVolumesFromSnapshotTest-62216531 None] Created volume successfully.
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dd7446-0560-4580-a92b-fcb1bc817d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8357b85f-acd0-44b6-8255-d8e02e13be48', 'volume_size': 1, 'image_id': 'e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b38675dfc4e8cd850172beaed522c17', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b10acb4c1b5e4f00bc49f5a5fa5217e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff08b2fc64f205a850c7fc75a47ac8fcaee2dbab7b6b5d338a7392b2ed527fe50e13935456b08b0e9cdb3e775ea0a3b1249dd89d559c06993ee9fcf9b83d3088', 'id': 'e7011e02-d7d0-449a-9bf5-71c1e54afd78', 'created_at': datetime.datetime(2026, 9, 11, 4, 32, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 32, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7011e02-d7d0-449a-9bf5-71c1e54afd78/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e030c9ad160>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1e9034-12a2-4ba7-bfb9-47d19d9a16aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Volume volume-8357b85f-acd0-44b6-8255-d8e02e13be48 (8357b85f-acd0-44b6-8255-d8e02e13be48): created successfully
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1e9034-12a2-4ba7-bfb9-47d19d9a16aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Flow 'volume_create_manager' (4fa787cb-5980-4521-a397-c7ea80139e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-db16a22e-4dcc-4584-9d68-fed5866e0c56 tempest-VolumeImageDependencyTests-630557057 None] Created volume successfully.
Sep 11 06:32:41 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9 1073741824" returned: 0 in 0.444s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:41 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-7bbf430a-697f-4b4f-85f1-311f0a09dad7-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f" returned: 0 in 0.487s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7160f64b-3495-491e-ae47-b9953491ba3b_17yspde2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:41 devstack sudo[105466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9
Sep 11 06:32:41 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-7bbf430a-697f-4b4f-85f1-311f0a09dad7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:41 devstack sudo[105468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f 1G
Sep 11 06:32:41 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-quobyte-7bbf430a-697f-4b4f-85f1-311f0a09dad7" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-7bbf430a-697f-4b4f-85f1-311f0a09dad7" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa26716-4113-4f90-bb0b-2973f3a271b6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:41 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7
Sep 11 06:32:41 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:41 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9" returned: 0 in 0.284s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.666s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-578984153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa68317-6f70-4069-bb69-1cc156dd3dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:37Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Creating volume 6aa68317-6f70-4069-bb69-1cc156dd3dbb {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:41 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb 1073741824
Sep 11 06:32:41 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8fa762-075c-4e2e-b052-d44652c4f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f3d59e-e146-41a6-8a61-06b1797ad2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9 (5fa7afc9-a823-48e5-99cc-81851e60f1c9): created successfully
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f3d59e-e146-41a6-8a61-06b1797ad2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (2076ab82-f406-493a-bd5e-9cf43f2b1476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-47909eab-0f08-4d61-932b-fbac76f54f15 tempest-CreateVolumesFromSnapshotTest-62216531 None] Created volume successfully.
Sep 11 06:32:41 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f 1G" returned: 0 in 0.383s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Downloaded image 7160f64b-3495-491e-ae47-b9953491ba3b ((None, [{'url': 'file:///opt/stack/data/glance/images/7160f64b-3495-491e-ae47-b9953491ba3b', 'metadata': {}}])) to volume 8ab51218-eefd-450a-9e8d-9b03808b5f8f successfully. {{(pid=88109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Temporary image 7160f64b-3495-491e-ae47-b9953491ba3b for user cbf870865e7a406683d34ace11e9cf9b is deleted. {{(pid=88109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.volume_utils [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Marking volume 8ab51218-eefd-450a-9e8d-9b03808b5f8f as bootable. {{(pid=88109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Copying metadata from image 7160f64b-3495-491e-ae47-b9953491ba3b to 8ab51218-eefd-450a-9e8d-9b03808b5f8f. {{(pid=88109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Creating volume glance metadata for volume 8ab51218-eefd-450a-9e8d-9b03808b5f8f backed by image 7160f64b-3495-491e-ae47-b9953491ba3b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7160f64b-3495-491e-ae47-b9953491ba3b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5ddc276bf80610547bc91bc48d4dfa7b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cb457c-ef18-49bd-9501-3a35060d5305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f', 'volume_size': 1, 'image_id': '7160f64b-3495-491e-ae47-b9953491ba3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7160f64b-3495-491e-ae47-b9953491ba3b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ddc276bf80610547bc91bc48d4dfa7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd3f264856585485591e67f8724d5143c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd7225254b2878e2ff123d7a2d9e601b6e6b7caf3520bdfb546dbae7f984d1c7f98fc95a9ce68ad17393e63b9ea528f6f0cc887ff0b392506f14944e70723daee', 'id': '7160f64b-3495-491e-ae47-b9953491ba3b', 'created_at': datetime.datetime(2026, 9, 11, 4, 32, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 4, 32, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7160f64b-3495-491e-ae47-b9953491ba3b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7e0316ebdfd0>}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c19185-13d3-4f87-a769-2c7fbebddfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Volume volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f (8ab51218-eefd-450a-9e8d-9b03808b5f8f): created successfully
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c19185-13d3-4f87-a769-2c7fbebddfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Flow 'volume_create_manager' (ac524b5a-6c2d-4aeb-8d4e-be509ce20f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:41 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:41 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-23b438f4-7b8f-45bd-a3bd-71237cc0169f tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Created volume successfully.
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7" returned: 0 in 0.443s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:41 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7
Sep 11 06:32:41 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Acquiring lock "cinder-8357b85f-acd0-44b6-8255-d8e02e13be48-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Lock "cinder-8357b85f-acd0-44b6-8255-d8e02e13be48-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Acquiring lock "cinder-quobyte-8357b85f-acd0-44b6-8255-d8e02e13be48" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Lock "cinder-quobyte-8357b85f-acd0-44b6-8255-d8e02e13be48" acquired by "delete_volume" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf7ddcc-a33f-4f77-a0e6-5ca439298e28]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:42 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb 1073741824" returned: 0 in 0.557s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:42 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7bbf430a-697f-4b4f-85f1-311f0a09dad7" returned: 0 in 0.310s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:42 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb
Sep 11 06:32:42 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-7bbf430a-697f-4b4f-85f1-311f0a09dad7" released by "delete_volume" :: held 0.811s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:42 devstack sudo[105487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48
Sep 11 06:32:42 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created reservations ['16c16876-9c23-47f1-b48a-36536b5fd3f6', 'a7778a5f-30b8-4ebe-a2b7-0d12ea69836f', '97505e42-14df-4718-895a-659f105961d4', '61c1ef79-7a82-4f0e-8dc7-279a1c14abd0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:42 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:42 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:42 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.183s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-589568902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c8a1d2-2dce-4e75-8ac5-84813254d587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217209be58cb4b26b7c949444f584f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:37Z,use_quota=True,user_id='581514db154f4f4796f46a27121302a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Creating volume 76c8a1d2-2dce-4e75-8ac5-84813254d587 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:42 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-bc54ace9-09d0-4330-8652-0769a9912d89-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:42 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:42 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587 1073741824
Sep 11 06:32:42 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcfb8f7-13e4-4348-87a3-fc47afba4fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8100ec81-e586-4893-82b9-f047c03be83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48" returned: 0 in 0.458s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-bc54ace9-09d0-4330-8652-0769a9912d89-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:42 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb (6aa68317-6f70-4069-bb69-1cc156dd3dbb): created successfully
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8100ec81-e586-4893-82b9-f047c03be83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (e74d68cb-ed65-442a-bfb1-15dbd25e3f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:42 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48
Sep 11 06:32:42 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-976559fa-78ba-4e13-9582-8c07b037932d tempest-CreateVolumesFromSnapshotTest-62216531 None] Created volume successfully.
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-quobyte-bc54ace9-09d0-4330-8652-0769a9912d89" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:42 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Deleted volume successfully.
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-bc54ace9-09d0-4330-8652-0769a9912d89" acquired by "delete_volume" :: waited 0.049s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-967fe9ce-3936-4198-9b3e-5e00534a1834 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-7bbf430a-697f-4b4f-85f1-311f0a09dad7-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce256035-9dfd-4772-aae8-003ee588dbb0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:42 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89
Sep 11 06:32:42 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:42 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8357b85f-acd0-44b6-8255-d8e02e13be48" returned: 0 in 0.355s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Acquiring lock "cinder-8ab51218-eefd-450a-9e8d-9b03808b5f8f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:42 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Lock "cinder-quobyte-8357b85f-acd0-44b6-8255-d8e02e13be48" released by "delete_volume" :: held 0.866s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "cinder-8ab51218-eefd-450a-9e8d-9b03808b5f8f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Acquiring lock "cinder-quobyte-8ab51218-eefd-450a-9e8d-9b03808b5f8f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "cinder-quobyte-8ab51218-eefd-450a-9e8d-9b03808b5f8f" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Created reservations ['84ae5bf9-b03a-4d00-b039-72592c5019b1', '30b69ca9-abde-487b-b12a-12b4b6f1eb6d', 'af4b94da-4e03-4636-b3cb-641cfefebe64', 'd4224321-0ca8-4b56-9250-ce3d70f64ed0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d397aaa1-6fb1-4583-b7d9-ba5a023f5b5b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:43 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587 1073741824" returned: 0 in 0.724s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:43 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:43 devstack sudo[105510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f
Sep 11 06:32:43 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:43 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:43 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89" returned: 0 in 0.543s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:43 devstack sudo[105517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587
Sep 11 06:32:43 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:43 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89
Sep 11 06:32:43 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:43 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.293s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Deleted volume successfully.
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d644af25-96fe-407f-8731-38a055da65d2 tempest-VolumeImageDependencyTests-630557057 None] Lock "cinder-8357b85f-acd0-44b6-8255-d8e02e13be48-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:43 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f" returned: 0 in 0.504s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:43 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f
Sep 11 06:32:43 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:43 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:43 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a526b208-c031-41c5-8235-82e5bc545374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c8a1d2-2dce-4e75-8ac5-84813254d587', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c31c4f1-bc0d-4469-9b63-d7b9fd951a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-bc54ace9-09d0-4330-8652-0769a9912d89" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-bc54ace9-09d0-4330-8652-0769a9912d89" released by "delete_volume" :: held 0.978s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Volume volume-76c8a1d2-2dce-4e75-8ac5-84813254d587 (76c8a1d2-2dce-4e75-8ac5-84813254d587): created successfully
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c31c4f1-bc0d-4469-9b63-d7b9fd951a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Flow 'volume_create_manager' (f8d0801c-39d5-4050-91e7-f01951d0c342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0e8fb9c6-f971-415a-9bfb-ecfb640733be tempest-CreateVolumesFromSnapshotTest-62216531 None] Created volume successfully.
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created reservations ['6c2da6e4-8ef9-49bd-a9b5-159706e12802', '3560e3ee-5d2f-411d-81e3-a0f346fed311', '5f7ddacf-489e-4974-ab4e-e0cde8a1f0eb', '9be60d89-6deb-41d2-9cfd-0a4b6ed944a1'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:43 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8ab51218-eefd-450a-9e8d-9b03808b5f8f" returned: 0 in 0.331s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "cinder-quobyte-8ab51218-eefd-450a-9e8d-9b03808b5f8f" released by "delete_volume" :: held 0.883s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-76c8a1d2-2dce-4e75-8ac5-84813254d587-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:44 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:44 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-76c8a1d2-2dce-4e75-8ac5-84813254d587-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-76c8a1d2-2dce-4e75-8ac5-84813254d587" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Created reservations ['bfbcaf1c-7fda-461b-99e6-4a3a88c0068e', '47e4c2e1-2f0f-480e-a728-df97c1a0b3c6', '6d79b8b3-498a-4060-9d63-61f9a581e1be', 'c8272d56-f184-4738-8d53-a8779a0f8266'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-76c8a1d2-2dce-4e75-8ac5-84813254d587" acquired by "delete_volume" :: waited 0.052s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1163cf-61c3-4912-aa15-c9e4476afcb2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:44 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:44 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:44 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587
Sep 11 06:32:44 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:44 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:44 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Deleted volume successfully.
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-43c82f62-4850-4acf-abab-b76123865349 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-bc54ace9-09d0-4330-8652-0769a9912d89-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:44 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.292s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:44 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Deleted volume successfully.
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0808f96d-2ab8-4d1d-9cfd-4005523e39dd tempest-VolumeAndVolumeTypeFromImageTest-478227114 None] Lock "cinder-8ab51218-eefd-450a-9e8d-9b03808b5f8f-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:44 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587" returned: 0 in 0.464s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:44 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587
Sep 11 06:32:44 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-8154a611-e95a-422f-a55e-c848f925768a-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-8154a611-e95a-422f-a55e-c848f925768a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-quobyte-8154a611-e95a-422f-a55e-c848f925768a" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-8154a611-e95a-422f-a55e-c848f925768a" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[408a822f-7d81-4b02-82f8-275af3d989e9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:44 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-76c8a1d2-2dce-4e75-8ac5-84813254d587" returned: 0 in 0.314s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-76c8a1d2-2dce-4e75-8ac5-84813254d587" released by "delete_volume" :: held 0.833s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Created reservations ['ec3fe91d-9641-4d7b-bf03-64c4bfbafb3e', 'c0fb28d8-96c0-470e-8da1-57f0d0048d8f', 'abf55754-93d2-4555-aee5-15635699d526', 'f61aa21b-e81b-452d-9fa4-9e84c7d6895b'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:45 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a
Sep 11 06:32:45 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:45 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:45 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-6aa68317-6f70-4069-bb69-1cc156dd3dbb-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-6aa68317-6f70-4069-bb69-1cc156dd3dbb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-6aa68317-6f70-4069-bb69-1cc156dd3dbb" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-6aa68317-6f70-4069-bb69-1cc156dd3dbb" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a6dfa-6782-47a0-b5da-b92dca19da8a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:45 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a" returned: 0 in 0.550s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:45 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.376s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:45 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:45 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Deleted volume successfully.
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4f8643ed-260a-479c-a6d2-d3563350a20b tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-76c8a1d2-2dce-4e75-8ac5-84813254d587-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:45 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb
Sep 11 06:32:45 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:45 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-8154a611-e95a-422f-a55e-c848f925768a" returned: 0 in 0.293s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-8154a611-e95a-422f-a55e-c848f925768a" released by "delete_volume" :: held 0.909s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created reservations ['69dccf3b-1632-40c2-abbd-24165e80d876', '66e2662c-d7da-4ba3-8c34-10761449cea8', '297cf09c-d7f7-44fb-bd68-8331b0f24f95', '8c084b92-d432-4e14-bd31-3259fa1c414f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:45 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb" returned: 0 in 0.506s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:46 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb
Sep 11 06:32:46 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-34f3486e-fa06-4b55-88ad-9ef573bf94f7-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-34f3486e-fa06-4b55-88ad-9ef573bf94f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:46 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:46 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "cinder-quobyte-34f3486e-fa06-4b55-88ad-9ef573bf94f7" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-34f3486e-fa06-4b55-88ad-9ef573bf94f7" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef796b4-7634-4ac1-ae42-451b304f8242]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:46 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7
Sep 11 06:32:46 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:46 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6aa68317-6f70-4069-bb69-1cc156dd3dbb" returned: 0 in 0.502s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-6aa68317-6f70-4069-bb69-1cc156dd3dbb" released by "delete_volume" :: held 1.104s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:46 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.463s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Deleted volume successfully.
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3b31fa2f-fcb0-4829-8f43-d0cf41b3941d tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-8154a611-e95a-422f-a55e-c848f925768a-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Created reservations ['e019bfed-c155-419c-a4f4-2ec125c40dff', '2bdd4a0d-6491-43df-8b87-4744d6259366', 'e15aa388-c647-48a2-b0c5-6f80c6774e0c', 'e041b127-e96d-4e3e-b419-b04651ad05c5'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:46 devstack sudo[105578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:46 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:46 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7" returned: 0 in 0.521s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:46 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7
Sep 11 06:32:46 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:47 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.325s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Deleted volume successfully.
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-16149449-8fc9-4397-8bc6-3591050d485c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-6aa68317-6f70-4069-bb69-1cc156dd3dbb-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:47 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-34f3486e-fa06-4b55-88ad-9ef573bf94f7" returned: 0 in 0.302s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-quobyte-34f3486e-fa06-4b55-88ad-9ef573bf94f7" released by "delete_volume" :: held 0.882s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Created reservations ['f0a17a69-e16b-49d6-9de2-d2d1edb83bd2', 'c8957e39-8990-4453-a738-9a437d20fca0', 'eba771a6-e796-4c4a-b980-3acf5974c009', '87aa8e50-159f-4191-97e6-afbe62a663d7'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:47 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:47 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:47 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Deleted volume successfully.
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-5fa7afc9-a823-48e5-99cc-81851e60f1c9-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c88bccad-50fa-4d73-a83a-38baa7dd2200 tempest-CreateVolumesFromSourceVolumeTest-1155989648 None] Lock "cinder-34f3486e-fa06-4b55-88ad-9ef573bf94f7-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-5fa7afc9-a823-48e5-99cc-81851e60f1c9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-5fa7afc9-a823-48e5-99cc-81851e60f1c9" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-5fa7afc9-a823-48e5-99cc-81851e60f1c9" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35aceb9-68ad-4b80-8271-6ac6bde6416d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:47 devstack sudo[105588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9
Sep 11 06:32:47 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:48 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9" returned: 0 in 0.545s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:48 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9
Sep 11 06:32:48 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:48 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5fa7afc9-a823-48e5-99cc-81851e60f1c9" returned: 0 in 0.332s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-5fa7afc9-a823-48e5-99cc-81851e60f1c9" released by "delete_volume" :: held 0.943s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Created reservations ['73316f58-f204-488c-9eb5-556e487d36cf', '729c7448-0446-40d3-8ff6-5ebca7abd58a', '7d15af02-4f15-41e5-b2c5-27bdbc121372', 'ddadb4d9-992e-4e19-b992-5530239f0b92'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:48 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:48 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:49 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.300s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:49 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:49 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Deleted volume successfully.
Sep 11 06:32:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fb212bd4-de4c-4a41-be5c-1214003dc048 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-5fa7afc9-a823-48e5-99cc-81851e60f1c9-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-2cfafe3d-460a-498d-af10-af4e83ebf171-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-2cfafe3d-460a-498d-af10-af4e83ebf171-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-2cfafe3d-460a-498d-af10-af4e83ebf171" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-2cfafe3d-460a-498d-af10-af4e83ebf171" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598abe2-ee33-4548-9420-5283ccf63f2a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:50 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171
Sep 11 06:32:50 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:50 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171" returned: 0 in 0.518s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:50 devstack sudo[105605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171
Sep 11 06:32:50 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:50 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-2cfafe3d-460a-498d-af10-af4e83ebf171" returned: 0 in 0.311s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-2cfafe3d-460a-498d-af10-af4e83ebf171" released by "delete_volume" :: held 0.888s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Created reservations ['2a16dd50-4b3b-4fb5-af95-52427ef28622', 'd51733cd-6add-4576-bd24-83de6fe22682', '8cbeadc6-015d-437d-b33d-5df4710a0828', 'ef0ffb58-2e4b-4da4-88cd-dea323f0a902'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:51 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:51 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-279f77de-b590-4dd2-a577-3049bd3e3ec1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-279f77de-b590-4dd2-a577-3049bd3e3ec1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-279f77de-b590-4dd2-a577-3049bd3e3ec1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-279f77de-b590-4dd2-a577-3049bd3e3ec1" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a2eae-7974-4bbf-b732-caea5809f928]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:51 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.286s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Deleted volume successfully.
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e4e9009e-9baa-430c-ad81-040851651322 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-2cfafe3d-460a-498d-af10-af4e83ebf171-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:51 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1
Sep 11 06:32:51 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:51 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1" returned: 0 in 0.516s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:51 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1
Sep 11 06:32:51 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Flow 'volume_create_manager' (33954963-3ee9-4ae9-9105-37a71fc5d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde5419b-8ca9-4292-9c93-6c33ab92cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde5419b-8ca9-4292-9c93-6c33ab92cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab11133-b380-434a-8f28-8ded56ffa02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d8aaf6ae4dd18ab4d5a0ee44e3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:52Z,use_quota=True,user_id='61921d59eefe49ec97ade949c5b59c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d26095-396e-44ac-b84a-570b4b93907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d26095-396e-44ac-b84a-570b4b93907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f1006e-5aaf-43e1-b410-13ca8b854f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f1006e-5aaf-43e1-b410-13ca8b854f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab11133-b380-434a-8f28-8ded56ffa02d', 'volume_name': 'volume-aab11133-b380-434a-8f28-8ded56ffa02d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33962d2c-f8ac-4ae4-b925-3d2fecb1d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33962d2c-f8ac-4ae4-b925-3d2fecb1d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385150e6-8d29-46f8-882d-a79191b31a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Volume aab11133-b380-434a-8f28-8ded56ffa02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab11133-b380-434a-8f28-8ded56ffa02d', 'volume_size': 1}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab11133-b380-434a-8f28-8ded56ffa02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d8aaf6ae4dd18ab4d5a0ee44e3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:52Z,use_quota=True,user_id='61921d59eefe49ec97ade949c5b59c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Creating volume aab11133-b380-434a-8f28-8ded56ffa02d {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:52 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:52 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d 1073741824
Sep 11 06:32:52 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (acd7d146-85eb-41c5-9063-e81a749c0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6e5075-e8ae-4d7d-beb4-ab6c316e12f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-279f77de-b590-4dd2-a577-3049bd3e3ec1" returned: 0 in 0.462s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6e5075-e8ae-4d7d-beb4-ab6c316e12f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161254762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0ce3bd-fcf4-44b4-8744-ab2c588b745c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:52Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af853644-1ea8-42c7-a8a4-772fa2382ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af853644-1ea8-42c7-a8a4-772fa2382ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37a271d-a6ef-4727-82f7-8c6981536b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37a271d-a6ef-4727-82f7-8c6981536b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0ce3bd-fcf4-44b4-8744-ab2c588b745c', 'volume_name': 'volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6cbc4d-87be-4c3e-bc9e-d2fd70037652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6cbc4d-87be-4c3e-bc9e-d2fd70037652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67762995-d4aa-4d9e-8b08-144a1b711d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Volume ac0ce3bd-fcf4-44b4-8744-ab2c588b745c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c', 'volume_size': 1}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-279f77de-b590-4dd2-a577-3049bd3e3ec1" released by "delete_volume" :: held 1.083s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Created reservations ['49d5c988-6a2c-47e7-9bfd-fcf6f5bf851d', '2c541615-aac4-4722-a9db-d0d67fdff820', '0e1ddab8-271f-428b-82b1-6e311384a732', '9b63a13a-aee3-4f79-b983-7061bbf341bd'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:52 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:52 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (df95d083-e44e-4344-8c3f-2a40b9efbb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc96d830-68da-407a-b8fb-71888fdf9933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc96d830-68da-407a-b8fb-71888fdf9933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018319989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5876b2f8-2339-4a52-80b1-ed97cb3941f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:53Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb415d80-3fa5-459b-b7be-8960a8ab5c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb415d80-3fa5-459b-b7be-8960a8ab5c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acb061e-7089-42f4-a133-1a9f8f77367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acb061e-7089-42f4-a133-1a9f8f77367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5876b2f8-2339-4a52-80b1-ed97cb3941f7', 'volume_name': 'volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2d77c0-2664-4f51-aff8-37ca34099751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2d77c0-2664-4f51-aff8-37ca34099751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a46bfdb-d826-492f-b4f6-97827f21c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Volume 5876b2f8-2339-4a52-80b1-ed97cb3941f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7', 'volume_size': 1}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:52 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.407s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Deleted volume successfully.
Sep 11 06:32:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-237b0f0b-3248-40c7-80cb-e5425aa6ac10 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-279f77de-b590-4dd2-a577-3049bd3e3ec1-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:52 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d 1073741824" returned: 0 in 0.774s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-66387a70-4089-439a-8e5e-af45f81ec3c6-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-66387a70-4089-439a-8e5e-af45f81ec3c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-560ee0af-7aa4-462e-bcfc-e572dd0356a8" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-560ee0af-7aa4-462e-bcfc-e572dd0356a8" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-66387a70-4089-439a-8e5e-af45f81ec3c6" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:53 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d
Sep 11 06:32:53 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-66387a70-4089-439a-8e5e-af45f81ec3c6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Deleting offline snapshot 66387a70-4089-439a-8e5e-af45f81ec3c6 of volume 560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] snapshot_file for this snap is: volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6035d34-9ddc-4973-837e-5c6aa4534f9f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:53 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6
Sep 11 06:32:53 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (8345a105-02e9-476e-9781-4b82437a31fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:53 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9274e95-d447-4f09-83b7-8b6a5aea88e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d" returned: 0 in 0.350s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161254762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0ce3bd-fcf4-44b4-8744-ab2c588b745c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:52Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Creating volume ac0ce3bd-fcf4-44b4-8744-ab2c588b745c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:53 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9274e95-d447-4f09-83b7-8b6a5aea88e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-335146439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348c4a14-dac2-4b85-952b-23caf8ab5776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:53Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f8693a-abe0-4b24-bd0b-bc1c457649ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f8693a-abe0-4b24-bd0b-bc1c457649ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04c51f-be5d-4bad-b336-658be6d67b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c 1073741824
Sep 11 06:32:53 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04c51f-be5d-4bad-b336-658be6d67b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348c4a14-dac2-4b85-952b-23caf8ab5776', 'volume_name': 'volume-348c4a14-dac2-4b85-952b-23caf8ab5776', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c870b21-109f-4981-a66c-3802e3fa1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c870b21-109f-4981-a66c-3802e3fa1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e1bc53-ec77-40c9-9892-9fdfed5fe5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Volume 348c4a14-dac2-4b85-952b-23caf8ab5776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348c4a14-dac2-4b85-952b-23caf8ab5776', 'volume_size': 1}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385150e6-8d29-46f8-882d-a79191b31a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab11133-b380-434a-8f28-8ded56ffa02d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4392db89-637f-4a03-853e-fdb2aaa3cac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Volume volume-aab11133-b380-434a-8f28-8ded56ffa02d (aab11133-b380-434a-8f28-8ded56ffa02d): created successfully
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4392db89-637f-4a03-853e-fdb2aaa3cac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Flow 'volume_create_manager' (33954963-3ee9-4ae9-9105-37a71fc5d38e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:53 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d84e6c04-7d39-4ef2-b102-d8c7d08f25e3 tempest-CinderUnicodeTest-2091577481 None] Created volume successfully.
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (01d16011-ce07-4b4c-9165-edf519a41829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391b6b4b-06da-4ae6-8c36-94126e9d7962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391b6b4b-06da-4ae6-8c36-94126e9d7962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-774853657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc9422f-a45d-4ba7-b2c6-6ffb118e6f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:54Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f1e6cd-1f77-4e86-aa4b-60932c631dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f1e6cd-1f77-4e86-aa4b-60932c631dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f45573-5d8f-483f-bbb5-9d9ff000a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f45573-5d8f-483f-bbb5-9d9ff000a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc9422f-a45d-4ba7-b2c6-6ffb118e6f33', 'volume_name': 'volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165ee72b-3043-4865-9a12-44e23137e339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165ee72b-3043-4865-9a12-44e23137e339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bc4814-1d0c-4a44-9f4e-a9ec3a693a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Volume edc9422f-a45d-4ba7-b2c6-6ffb118e6f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33', 'volume_size': 1}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6" returned: 0 in 0.530s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[747cd69e-a7c1-432c-babc-39f65138fcd1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:53 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8
Sep 11 06:32:53 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:54 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c 1073741824" returned: 0 in 0.729s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:54 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8" returned: 0 in 0.512s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:54 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c
Sep 11 06:32:54 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:54 devstack sudo[105649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6
Sep 11 06:32:54 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (9569dc40-1928-4ea0-8cd5-fc77635e3906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733c88b7-35a9-48fc-9e39-b20c5e827e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733c88b7-35a9-48fc-9e39-b20c5e827e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-969885518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c579d928-b599-4cc5-9302-be258c51b4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:54Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1111aa2e-cfa1-4f75-ae0b-7fe463e807a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1111aa2e-cfa1-4f75-ae0b-7fe463e807a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6406a75c-f712-421b-9a03-100e7425c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6406a75c-f712-421b-9a03-100e7425c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c579d928-b599-4cc5-9302-be258c51b4b4', 'volume_name': 'volume-c579d928-b599-4cc5-9302-be258c51b4b4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ec0914-51be-4b31-9500-37ff01eb4417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ec0914-51be-4b31-9500-37ff01eb4417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d127ad5-abc5-458b-b858-5487198467d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:54 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Volume c579d928-b599-4cc5-9302-be258c51b4b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c579d928-b599-4cc5-9302-be258c51b4b4', 'volume_size': 1}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:54 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c" returned: 0 in 0.375s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.834s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018319989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5876b2f8-2339-4a52-80b1-ed97cb3941f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:53Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Creating volume 5876b2f8-2339-4a52-80b1-ed97cb3941f7 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:54 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67762995-d4aa-4d9e-8b08-144a1b711d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d2a3e2-59b2-4738-a5a1-5120e9352c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:54 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7 1073741824
Sep 11 06:32:54 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:54 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Volume volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c (ac0ce3bd-fcf4-44b4-8744-ab2c588b745c): created successfully
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d2a3e2-59b2-4738-a5a1-5120e9352c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (acd7d146-85eb-41c5-9063-e81a749c0ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-955bf238-8f52-4735-96fb-207cc690bf76 tempest-CreateVolumesFromImageTest-1830538105 None] Created volume successfully.
Sep 11 06:32:54 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6" returned: 0 in 0.536s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:54 devstack sudo[105658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6
Sep 11 06:32:54 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:54 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Flow 'volume_create_manager' (44ecf37b-9d62-47a9-9460-2cb5fba55081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b077f0e7-b02d-48fe-b73b-5b606102d9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b077f0e7-b02d-48fe-b73b-5b606102d9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1401081593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2eefd6-9bad-455e-aed3-b43a1a5387e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d8aaf6ae4dd18ab4d5a0ee44e3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:55Z,use_quota=True,user_id='61921d59eefe49ec97ade949c5b59c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34406c1-1393-4843-8461-013a634f7352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34406c1-1393-4843-8461-013a634f7352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8877873e-c11d-45cd-93ca-7d09331e9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8877873e-c11d-45cd-93ca-7d09331e9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2eefd6-9bad-455e-aed3-b43a1a5387e6', 'volume_name': 'volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d82af-d573-42ee-86da-b86d407d69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2d82af-d573-42ee-86da-b86d407d69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b9b499-60d2-4cff-a5fa-d517d790ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:55 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Volume ac2eefd6-9bad-455e-aed3-b43a1a5387e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6', 'volume_size': 1}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:55 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8.66387a70-4089-439a-8e5e-af45f81ec3c6" returned: 0 in 0.303s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-66387a70-4089-439a-8e5e-af45f81ec3c6" released by "_delete_snapshot" :: held 2.027s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-560ee0af-7aa4-462e-bcfc-e572dd0356a8" released by "delete_snapshot" :: held 2.065s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Created reservations ['a8f65364-5153-4ebb-be49-f33bc9b63a95', 'fd87633f-893d-473f-8e1c-24364f79bdcc', '57c2f349-b89e-42fc-b6a8-decc18a75369', '2889d683-dcfc-463f-b33e-04ef4f534466'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:55 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7 1073741824" returned: 0 in 0.632s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Delete snapshot completed successfully.
Sep 11 06:32:55 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7
Sep 11 06:32:55 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-58e8b48e-534c-437d-a400-8f9332bc7003 tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-66387a70-4089-439a-8e5e-af45f81ec3c6-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:55 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-335146439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348c4a14-dac2-4b85-952b-23caf8ab5776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:53Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Creating volume 348c4a14-dac2-4b85-952b-23caf8ab5776 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:55 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:55 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776 1073741824
Sep 11 06:32:55 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a46bfdb-d826-492f-b4f6-97827f21c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4c67f6-7c5f-4d55-bfc1-d4e12162918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:55 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Volume volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7 (5876b2f8-2339-4a52-80b1-ed97cb3941f7): created successfully
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4c67f6-7c5f-4d55-bfc1-d4e12162918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:55 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (df95d083-e44e-4344-8c3f-2a40b9efbb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-377d304e-cad3-4454-bfe5-e0303a3b3030 tempest-CreateVolumesFromImageTest-1830538105 None] Created volume successfully.
Sep 11 06:32:56 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776 1073741824" returned: 0 in 0.499s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:56 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776
Sep 11 06:32:56 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-560ee0af-7aa4-462e-bcfc-e572dd0356a8-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-560ee0af-7aa4-462e-bcfc-e572dd0356a8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "cinder-quobyte-560ee0af-7aa4-462e-bcfc-e572dd0356a8" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:56 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776" returned: 0 in 0.321s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-774853657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc9422f-a45d-4ba7-b2c6-6ffb118e6f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:54Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Creating volume edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:56 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-560ee0af-7aa4-462e-bcfc-e572dd0356a8" acquired by "delete_volume" :: waited 0.040s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:56 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 1073741824
Sep 11 06:32:56 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e1bc53-ec77-40c9-9892-9fdfed5fe5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348c4a14-dac2-4b85-952b-23caf8ab5776', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c9d331-2faf-4c68-b368-0fdbd862257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7417953-b241-4829-a86d-2e67a2bd41a3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:56 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Volume volume-348c4a14-dac2-4b85-952b-23caf8ab5776 (348c4a14-dac2-4b85-952b-23caf8ab5776): created successfully
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c9d331-2faf-4c68-b368-0fdbd862257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (8345a105-02e9-476e-9781-4b82437a31fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8c9789d6-10fc-4f1b-a761-59839a188ffa tempest-CreateVolumesFromImageTest-1830538105 None] Created volume successfully.
Sep 11 06:32:56 devstack sudo[105679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8
Sep 11 06:32:56 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:57 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 1073741824" returned: 0 in 0.514s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:57 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8" returned: 0 in 0.445s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:57 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8
Sep 11 06:32:57 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:57 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33
Sep 11 06:32:57 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:57 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-560ee0af-7aa4-462e-bcfc-e572dd0356a8" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-quobyte-560ee0af-7aa4-462e-bcfc-e572dd0356a8" released by "delete_volume" :: held 0.828s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:57 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33" returned: 0 in 0.316s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.926s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-969885518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c579d928-b599-4cc5-9302-be258c51b4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2fce70e39344ada4c401ae9437cd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:54Z,use_quota=True,user_id='b930c22452684bfabaf3dd512a63ec31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Creating volume c579d928-b599-4cc5-9302-be258c51b4b4 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:57 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bc4814-1d0c-4a44-9f4e-a9ec3a693a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:57 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4 1073741824
Sep 11 06:32:57 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff1caf-a9f9-4dd9-9f38-86807fa33485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:57 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Volume volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 (edc9422f-a45d-4ba7-b2c6-6ffb118e6f33): created successfully
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff1caf-a9f9-4dd9-9f38-86807fa33485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (01d16011-ce07-4b4c-9165-edf519a41829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Created reservations ['571f51bd-ecc7-4483-ab31-1b9205e79f56', '4a14d898-7f14-416a-8323-955449e53fa8', '9c4658a2-93a5-4909-8489-dde1a32d520c', '7278f324-e4ea-4042-9733-59b447602365'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9ffcebc2-7a40-48ed-ac28-a6be62da32db tempest-CreateVolumesFromImageTest-1830538105 None] Created volume successfully.
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:57 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:57 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:57 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.293s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:32:58 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Deleted volume successfully.
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3edd6302-541f-4068-a696-326b317c245c tempest-CreateVolumesFromSnapshotTest-62216531 None] Lock "cinder-560ee0af-7aa4-462e-bcfc-e572dd0356a8-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:58 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4 1073741824" returned: 0 in 0.652s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:58 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4
Sep 11 06:32:58 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:58 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4" returned: 0 in 0.263s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.247s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:32:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1401081593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2eefd6-9bad-455e-aed3-b43a1a5387e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d8aaf6ae4dd18ab4d5a0ee44e3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:32:55Z,use_quota=True,user_id='61921d59eefe49ec97ade949c5b59c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Creating volume ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:32:58 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d127ad5-abc5-458b-b858-5487198467d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c579d928-b599-4cc5-9302-be258c51b4b4', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:58 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 1073741824
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9012092-03a8-46e7-8641-221763bec6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:58 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:58 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Volume volume-c579d928-b599-4cc5-9302-be258c51b4b4 (c579d928-b599-4cc5-9302-be258c51b4b4): created successfully
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9012092-03a8-46e7-8641-221763bec6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Flow 'volume_create_manager' (9569dc40-1928-4ea0-8cd5-fc77635e3906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:58 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-247fa9f1-2d1c-4b4f-8bc2-0792dba49208 tempest-CreateVolumesFromImageTest-1830538105 None] Created volume successfully.
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-c579d928-b599-4cc5-9302-be258c51b4b4-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:58 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 1073741824" returned: 0 in 0.574s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:58 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-c579d928-b599-4cc5-9302-be258c51b4b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-quobyte-c579d928-b599-4cc5-9302-be258c51b4b4" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-c579d928-b599-4cc5-9302-be258c51b4b4" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:32:59 devstack sudo[105717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6
Sep 11 06:32:59 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[98239a2c-276e-4295-8ab4-4795638b8e61]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:59 devstack sudo[105719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4
Sep 11 06:32:59 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:59 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" returned: 0 in 0.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b9b499-60d2-4cff-a5fa-d517d790ab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6734e3b1-2be6-434a-b81a-1e2207015036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:32:59 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Volume volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 (ac2eefd6-9bad-455e-aed3-b43a1a5387e6): created successfully
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6734e3b1-2be6-434a-b81a-1e2207015036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Flow 'volume_create_manager' (44ecf37b-9d62-47a9-9460-2cb5fba55081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:32:59 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-58fdee1a-1078-48ba-a612-99be95da01d3 tempest-CinderUnicodeTest-2091577481 None] Created volume successfully.
Sep 11 06:32:59 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4" returned: 0 in 0.390s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:59 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4
Sep 11 06:32:59 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:32:59 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-c579d928-b599-4cc5-9302-be258c51b4b4" returned: 0 in 0.255s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-c579d928-b599-4cc5-9302-be258c51b4b4" released by "delete_volume" :: held 0.689s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Created reservations ['e795eec4-6314-4d5f-906e-cd013e442f75', '21130c03-9d48-494f-9191-f623aa8c5a9c', 'b5a6474b-59ba-4e06-82cf-37877ae0b3e5', 'ce79164f-b3b4-48e1-b04f-a62aae060e7e'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:32:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:32:59 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:32:59 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:00 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.325s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:00 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Deleted volume successfully.
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-quobyte-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-3ab763cf-4f1d-4c1a-908b-464d76c23561 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-c579d928-b599-4cc5-9302-be258c51b4b4-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33" acquired by "delete_volume" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9d7b9a-751c-415e-b70a-c5dd1a6e2736]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:00 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33
Sep 11 06:33:00 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:00 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33" returned: 0 in 0.442s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:00 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:00 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Creating offline snapshot 1865b95a-41fb-4d01-bd8f-5e96d71299dd of volume ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4200f2e3-db10-4c8a-972a-8d498dadaf50]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:00 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6
Sep 11 06:33:00 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:01 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33" returned: 0 in 0.374s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33" released by "delete_volume" :: held 0.879s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Created reservations ['dfae9e81-ef85-424f-aedb-325f952390a2', '2dc9a0b8-ddc3-4d52-b921-1d63c704c687', '7e5cf39a-0d5d-4171-adb2-b4f438ec7362', '095db10d-c473-4762-b9b1-0b6184eb69dd'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:01 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" returned: 0 in 0.545s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:01 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd 1G
Sep 11 06:33:01 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:01 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:01 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:01 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.282s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:01 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Deleted volume successfully.
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-48c54f49-a1ce-4d11-a9cb-bb50359ea659 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-edc9422f-a45d-4ba7-b2c6-6ffb118e6f33-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:01 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd 1G" returned: 0 in 0.477s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:01 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd
Sep 11 06:33:01 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:02 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:02 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd is being set with open permissions: ugo+rw
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:02 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd
Sep 11 06:33:02 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-348c4a14-dac2-4b85-952b-23caf8ab5776-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:02 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-348c4a14-dac2-4b85-952b-23caf8ab5776-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-quobyte-348c4a14-dac2-4b85-952b-23caf8ab5776" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:02 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.info
Sep 11 06:33:02 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-348c4a14-dac2-4b85-952b-23caf8ab5776" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d03c80-9317-4f12-95c4-d1b34ed0f3db]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-839c99ba-8e5d-414f-9cdc-8e28d758c09c tempest-ProjectAdminTests-1578373274 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.230613708496, 'free_capacity_gb': 1773.230613708496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 11 06:33:02 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776
Sep 11 06:33:02 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:02 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.info" returned: 0 in 0.368s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:02 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.info is being set with open permissions: ugo+rw
Sep 11 06:33:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:02 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.info
Sep 11 06:33:02 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:03 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776" returned: 0 in 0.462s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:03 devstack sudo[105773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776
Sep 11 06:33:03 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:03 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.info" returned: 0 in 0.321s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1152dc3d-830f-45ea-848e-15aed48351b8 tempest-CinderUnicodeTest-2091577481 None] Create snapshot completed successfully
Sep 11 06:33:03 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-348c4a14-dac2-4b85-952b-23caf8ab5776" returned: 0 in 0.316s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-348c4a14-dac2-4b85-952b-23caf8ab5776" released by "delete_volume" :: held 0.828s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Created reservations ['da33225e-261e-4334-8e6d-42f497d52adf', '33130724-54c5-4f49-9f89-89d0f9f4169f', '1513b0ff-a0cf-4cd6-bd16-e2725471aa60', 'e1441473-9936-4dd5-8f9c-669455ad3ff9'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:03 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:03 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-5876b2f8-2339-4a52-80b1-ed97cb3941f7-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-5876b2f8-2339-4a52-80b1-ed97cb3941f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-quobyte-5876b2f8-2339-4a52-80b1-ed97cb3941f7" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-5876b2f8-2339-4a52-80b1-ed97cb3941f7" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:03 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Deleted volume successfully.
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe0fec6-8184-410f-9a16-35be2c232efe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b24608e2-b6fd-4feb-a727-caf9fcd10c56 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-348c4a14-dac2-4b85-952b-23caf8ab5776-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:03 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7
Sep 11 06:33:03 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "cinder-1865b95a-41fb-4d01-bd8f-5e96d71299dd-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-1865b95a-41fb-4d01-bd8f-5e96d71299dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "cinder-quobyte-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "cinder-quobyte-1865b95a-41fb-4d01-bd8f-5e96d71299dd" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-1865b95a-41fb-4d01-bd8f-5e96d71299dd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Deleting offline snapshot 1865b95a-41fb-4d01-bd8f-5e96d71299dd of volume ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] snapshot_file for this snap is: volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c78cbc-52b0-4caf-89d7-41271bf54fea]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:04 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd
Sep 11 06:33:04 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:04 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7" returned: 0 in 0.477s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:04 devstack sudo[105788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7
Sep 11 06:33:04 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:04 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd" returned: 0 in 0.390s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[febfb11b-4ead-4a51-872d-13d36a7709f5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:04 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-5876b2f8-2339-4a52-80b1-ed97cb3941f7" returned: 0 in 0.304s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-5876b2f8-2339-4a52-80b1-ed97cb3941f7" released by "delete_volume" :: held 0.850s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:04 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6
Sep 11 06:33:04 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Created reservations ['56350f86-096e-4b23-a72c-e497c016fb21', '4b58a710-3f3e-4b4d-9a0b-323962c27744', '5a5743a1-c079-4d1f-8cea-37b76431c2c6', '59b5ee47-2970-4bc7-8e94-b5162836cc12'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:04 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:04 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "cinder-quobyte-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c" acquired by "delete_volume" :: waited 0.048s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c930f2-9119-4d62-9468-adb9a2634ddc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:05 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" returned: 0 in 0.570s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:05 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd
Sep 11 06:33:05 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:05 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c
Sep 11 06:33:05 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.510s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:05 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Deleted volume successfully.
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18dc0595-2842-4053-ab26-8f5092c0d59e tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-5876b2f8-2339-4a52-80b1-ed97cb3941f7-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:05 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd" returned: 0 in 0.453s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:05 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd
Sep 11 06:33:05 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:05 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c" returned: 0 in 0.564s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:05 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c
Sep 11 06:33:05 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:05 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6.1865b95a-41fb-4d01-bd8f-5e96d71299dd" returned: 0 in 0.330s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-1865b95a-41fb-4d01-bd8f-5e96d71299dd" released by "_delete_snapshot" :: held 1.899s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" released by "delete_snapshot" :: held 1.938s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:05 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c" returned: 0 in 0.348s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-quobyte-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c" released by "delete_volume" :: held 1.007s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Created reservations ['feb19703-3f36-41cc-8ad7-3fcb30eb69cf', '693636f1-f36c-4486-a1b5-915dd1c50d8f', 'd277df5c-fbba-4c2d-8a46-8ad89bd8a382', 'e1becde1-d57a-4f3e-aa83-401716d30dd6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Created reservations ['7ce9844d-81ac-4b47-acf3-36e270b6a839', 'cda072c4-93e4-4361-8427-f223f2d430c9', 'ac9b5c21-5d70-41d5-b75a-b17993e6925b', '86a378c3-c226-4e0a-98e0-b900de5e87a6'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Delete snapshot completed successfully.
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-9393a039-92fa-4bd0-b9ed-f7897ad8e9ce tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-1865b95a-41fb-4d01-bd8f-5e96d71299dd-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:06 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:06 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:06 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Deleted volume successfully.
Sep 11 06:33:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c2e33e3f-6aca-481b-9063-3616a9348a07 tempest-CreateVolumesFromImageTest-1830538105 None] Lock "cinder-ac0ce3bd-fcf4-44b4-8744-ab2c588b745c-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "cinder-ac2eefd6-9bad-455e-aed3-b43a1a5387e6-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-ac2eefd6-9bad-455e-aed3-b43a1a5387e6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "cinder-quobyte-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" acquired by "delete_volume" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e90e4a-98c5-44bb-8d86-0717197bec24]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:07 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:07 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (9717fb9e-65de-42f3-8b2c-fc60f323027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e8641e-c7b8-4a88-89e9-c31958e43506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e8641e-c7b8-4a88-89e9-c31958e43506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236060875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d157da-17cf-48cc-a955-59fa25032427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:08Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844c5b9f-4222-49b2-9baf-cda9469d2781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844c5b9f-4222-49b2-9baf-cda9469d2781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f50456-bb6e-4967-b2be-ba794e52ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f50456-bb6e-4967-b2be-ba794e52ae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d157da-17cf-48cc-a955-59fa25032427', 'volume_name': 'volume-51d157da-17cf-48cc-a955-59fa25032427', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc29b3a-b7ea-48c1-bc5b-acfb83a7c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc29b3a-b7ea-48c1-bc5b-acfb83a7c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87749b5e-0176-4d91-9845-b4cf25823664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:07 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Volume 51d157da-17cf-48cc-a955-59fa25032427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d157da-17cf-48cc-a955-59fa25032427', 'volume_size': 1}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236060875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d157da-17cf-48cc-a955-59fa25032427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:08Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Creating volume 51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:07 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:07 devstack sudo[105824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 1073741824
Sep 11 06:33:07 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:07 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" returned: 0 in 0.421s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:07 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6
Sep 11 06:33:07 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:08 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" returned: 0 in 0.316s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-ac2eefd6-9bad-455e-aed3-b43a1a5387e6" released by "delete_volume" :: held 0.825s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:08 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 1073741824" returned: 0 in 0.510s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:08 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427
Sep 11 06:33:08 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Created reservations ['78150805-ee07-46ff-b4a1-9df4d6349042', 'b7010b1c-a9b5-4454-a845-02f42ce24e53', 'f7d977da-931f-40dc-bae4-e614b22c341a', '060e0eb6-fbbb-4cb5-b2fe-a009ed7ad625'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:08 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:08 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "cinder-aab11133-b380-434a-8f28-8ded56ffa02d-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-aab11133-b380-434a-8f28-8ded56ffa02d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "cinder-quobyte-aab11133-b380-434a-8f28-8ded56ffa02d" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:08 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427" returned: 0 in 0.367s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-aab11133-b380-434a-8f28-8ded56ffa02d" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87749b5e-0176-4d91-9845-b4cf25823664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d157da-17cf-48cc-a955-59fa25032427', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d249f32-6ef0-41e3-ba47-7844048dd5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4ba1b7-1fcc-4658-9a78-28bf5a6473eb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Volume volume-51d157da-17cf-48cc-a955-59fa25032427 (51d157da-17cf-48cc-a955-59fa25032427): created successfully
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d249f32-6ef0-41e3-ba47-7844048dd5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (9717fb9e-65de-42f3-8b2c-fc60f323027c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-ce6ad563-4dfd-46f9-a0cd-76951634d90c tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:33:08 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.410s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Deleted volume successfully.
Sep 11 06:33:08 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d
Sep 11 06:33:08 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d151f23b-e793-41d1-aeec-aea012458321 tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-ac2eefd6-9bad-455e-aed3-b43a1a5387e6-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:09 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d" returned: 0 in 0.419s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:09 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d
Sep 11 06:33:09 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:09 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aab11133-b380-434a-8f28-8ded56ffa02d" returned: 0 in 0.243s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-quobyte-aab11133-b380-434a-8f28-8ded56ffa02d" released by "delete_volume" :: held 0.710s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Created reservations ['37c4e51f-6e87-4563-a332-fdef74fa0ad1', '051a3c33-9fb8-4532-b81f-0e9f727835fb', '104fb8c1-97d2-4e38-af8f-bc1ff528eb4d', '298dca2d-e4e5-4ab3-ad54-68e1d85ff837'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:09 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:09 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:09 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.264s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:09 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Deleted volume successfully.
Sep 11 06:33:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8284401b-efb5-4114-a6b1-870aca9f4c4f tempest-CinderUnicodeTest-2091577481 None] Lock "cinder-aab11133-b380-434a-8f28-8ded56ffa02d-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Creating offline snapshot 2a3aef13-dfb1-4a53-9a94-b939c1310897 of volume 51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e9bc7-f4cf-4e01-9477-a65b9af03953]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:10 devstack sudo[105855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427
Sep 11 06:33:10 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Flow 'volume_create_manager' (7b87059f-6195-4ca0-90f0-2b24e3bcc354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ee735b-4c43-43f8-a3f6-70a2401be29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ee735b-4c43-43f8-a3f6-70a2401be29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048510428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34524e266df4f7592b44bf88f5f7ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:11Z,use_quota=True,user_id='b572240cd0cd4bdbb7f96171c8a6afdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28912a6a-d1db-42d6-ad46-54170e77686c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28912a6a-d1db-42d6-ad46-54170e77686c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb71491-27b9-4f27-997e-d33af9417cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb71491-27b9-4f27-997e-d33af9417cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88', 'volume_name': 'volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b30d1a6-a6b3-45db-93d1-a19d1dd74bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b30d1a6-a6b3-45db-93d1-a19d1dd74bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba90e9b4-38bb-4aca-b6a2-d7639f2797b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Volume cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88', 'volume_size': 1}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:10 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:10 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 1G
Sep 11 06:33:10 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:11 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 1G" returned: 0 in 0.433s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d157da-17cf-48cc-a955-59fa25032427 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:11 devstack sudo[105866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d157da-17cf-48cc-a955-59fa25032427 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897
Sep 11 06:33:11 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:11 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d157da-17cf-48cc-a955-59fa25032427 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897" returned: 0 in 0.297s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:11 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 is being set with open permissions: ugo+rw
Sep 11 06:33:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:11 devstack sudo[105871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897
Sep 11 06:33:11 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:11 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897" returned: 0 in 0.263s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:12 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.info
Sep 11 06:33:12 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:12 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.info" returned: 0 in 0.255s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:12 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.info is being set with open permissions: ugo+rw
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:12 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.info
Sep 11 06:33:12 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:12 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.info" returned: 0 in 0.249s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048510428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34524e266df4f7592b44bf88f5f7ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:11Z,use_quota=True,user_id='b572240cd0cd4bdbb7f96171c8a6afdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Creating volume cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:12 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:12 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 1073741824
Sep 11 06:33:12 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6bab6931-a07a-4f1f-9d78-9e15e61860ff tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:33:12 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 1073741824" returned: 0 in 0.450s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:13 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88
Sep 11 06:33:13 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:13 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba90e9b4-38bb-4aca-b6a2-d7639f2797b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369bb712-504f-40c4-b6f8-b31fa7233f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Volume volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 (cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88): created successfully
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369bb712-504f-40c4-b6f8-b31fa7233f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Flow 'volume_create_manager' (7b87059f-6195-4ca0-90f0-2b24e3bcc354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d746f1ee-2bfa-4e52-b111-eb22df138429 tempest-VolumeDependencyTests-1663826767 None] Created volume successfully.
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-2a3aef13-dfb1-4a53-9a94-b939c1310897-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Lock "cinder-2a3aef13-dfb1-4a53-9a94-b939c1310897-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-51d157da-17cf-48cc-a955-59fa25032427" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-51d157da-17cf-48cc-a955-59fa25032427" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-2a3aef13-dfb1-4a53-9a94-b939c1310897" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-2a3aef13-dfb1-4a53-9a94-b939c1310897" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot 2a3aef13-dfb1-4a53-9a94-b939c1310897 of volume 51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceab98c-7cab-48f4-99d8-658a29b3badf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:13 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897
Sep 11 06:33:13 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:14 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897" returned: 0 in 0.415s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51d157da-17cf-48cc-a955-59fa25032427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7968a773-688b-45b2-9fdb-2cdf14585806]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Creating offline snapshot 64c70bb9-c591-4c65-aad8-f80f4f143386 of volume cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[834ba98b-50f5-4c74-bf53-8f9700e5eb46]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:14 devstack sudo[105895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427
Sep 11 06:33:14 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:14 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88
Sep 11 06:33:14 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:14 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427" returned: 0 in 0.387s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:14 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897
Sep 11 06:33:14 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:14 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:14 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 1G
Sep 11 06:33:14 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:14 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897" returned: 0 in 0.386s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:14 devstack sudo[105918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897
Sep 11 06:33:14 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:15 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 1G" returned: 0 in 0.498s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:15 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386
Sep 11 06:33:15 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:15 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427.2a3aef13-dfb1-4a53-9a94-b939c1310897" returned: 0 in 0.323s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-2a3aef13-dfb1-4a53-9a94-b939c1310897" released by "_delete_snapshot" :: held 1.646s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-51d157da-17cf-48cc-a955-59fa25032427" released by "delete_snapshot" :: held 1.675s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Created reservations ['7c990c29-e266-46d9-9841-6b859bdf485b', '2f2dc017-96ea-417d-b1cd-3322cbd1fb99', '7f96ca1c-c065-4162-a003-e6e973f33757', '77d44991-c7c9-4bd7-9477-7fcfb3d1d3bf'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:15 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4ff8f3ed-a3ec-47da-8d81-a0dd8ac71050 tempest-ProjectMemberTests-716560810 None] Lock "cinder-2a3aef13-dfb1-4a53-9a94-b939c1310897-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:15 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386" returned: 0 in 0.333s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:15 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 is being set with open permissions: ugo+rw
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:15 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386
Sep 11 06:33:15 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:15 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386" returned: 0 in 0.274s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-51d157da-17cf-48cc-a955-59fa25032427-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:15 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.info
Sep 11 06:33:15 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Lock "cinder-51d157da-17cf-48cc-a955-59fa25032427-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-51d157da-17cf-48cc-a955-59fa25032427" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-51d157da-17cf-48cc-a955-59fa25032427" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe403e4-4122-459b-a04e-3267a37eaaf3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:16 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427
Sep 11 06:33:16 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:16 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.info" returned: 0 in 0.331s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:16 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.info is being set with open permissions: ugo+rw
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:16 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.info
Sep 11 06:33:16 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:16 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427" returned: 0 in 0.435s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:16 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.info" returned: 0 in 0.287s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:16 devstack sudo[105941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427
Sep 11 06:33:16 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fbf38de2-869b-4eb1-829d-74acfef82e2e tempest-VolumeDependencyTests-1663826767 None] Create snapshot completed successfully
Sep 11 06:33:16 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-51d157da-17cf-48cc-a955-59fa25032427" returned: 0 in 0.271s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-51d157da-17cf-48cc-a955-59fa25032427" released by "delete_volume" :: held 0.773s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Created reservations ['cc97b0a5-e227-468a-ad0e-bba69f5ae475', '542f4d04-f23c-4003-9cb3-65d6fb31abf5', '7fb257d1-8b57-41e0-b804-c0c2ad227aa9', '60ee0d46-a906-46a8-8a6a-bb810a3f9c7a'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:16 devstack sudo[105944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:16 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:16 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.265s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:16 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56732f79-536d-487b-84ee-c5707a725190 tempest-ProjectMemberTests-716560810 None] Lock "cinder-51d157da-17cf-48cc-a955-59fa25032427-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (4e9510b6-a8f2-4068-bcb6-affb2d9516e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555c82ea-0d26-4717-87ff-a98cd214aa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555c82ea-0d26-4717-87ff-a98cd214aa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021214942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00eb086c-a167-4bfd-96fc-60b4f237f15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:17Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a6f3aa-f6bd-45d2-9dd0-2b609ff5cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a6f3aa-f6bd-45d2-9dd0-2b609ff5cab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998ba50a-2a71-4a3f-b567-718af60c7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998ba50a-2a71-4a3f-b567-718af60c7e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00eb086c-a167-4bfd-96fc-60b4f237f15c', 'volume_name': 'volume-00eb086c-a167-4bfd-96fc-60b4f237f15c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1d6b6a-5665-49eb-a87e-c672f6bac8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1d6b6a-5665-49eb-a87e-c672f6bac8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828570b3-497f-4cad-9a24-bede9cea0e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:17 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Volume 00eb086c-a167-4bfd-96fc-60b4f237f15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00eb086c-a167-4bfd-96fc-60b4f237f15c', 'volume_size': 1}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021214942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00eb086c-a167-4bfd-96fc-60b4f237f15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:17Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Creating volume 00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:17 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:17 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c 1073741824
Sep 11 06:33:17 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Flow 'volume_create_manager' (abfe12ae-f414-4e03-b617-a3fd77fcea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:17 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9e9532-deee-4c7b-99f2-dbe1a2d2bb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9e9532-deee-4c7b-99f2-dbe1a2d2bb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-551342454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e0884a-7017-4e8c-ac20-d20c08cd0b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34524e266df4f7592b44bf88f5f7ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64c70bb9-c591-4c65-aad8-f80f4f143386,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:18Z,use_quota=True,user_id='b572240cd0cd4bdbb7f96171c8a6afdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50e2c3b-0419-492d-8a41-4799e480a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50e2c3b-0419-492d-8a41-4799e480a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e6534c-8ab7-4cb6-bd38-f2a022a10d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e6534c-8ab7-4cb6-bd38-f2a022a10d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00e0884a-7017-4e8c-ac20-d20c08cd0b50', 'volume_name': 'volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50', 'volume_size': 1, 'snapshot_id': '64c70bb9-c591-4c65-aad8-f80f4f143386'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cbab6a-4f1d-479b-9009-aea9c4ad3158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cbab6a-4f1d-479b-9009-aea9c4ad3158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e9f2ce-f48d-41f0-858f-25ed22adac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:18 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Volume 00e0884a-7017-4e8c-ac20-d20c08cd0b50: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50', 'volume_size': 1, 'snapshot_id': '64c70bb9-c591-4c65-aad8-f80f4f143386'}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:18 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c 1073741824" returned: 0 in 0.543s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:18 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c
Sep 11 06:33:18 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:18 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c" returned: 0 in 0.264s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.327s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-quobyte-64c70bb9-c591-4c65-aad8-f80f4f143386-00e0884a-7017-4e8c-ac20-d20c08cd0b50" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828570b3-497f-4cad-9a24-bede9cea0e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00eb086c-a167-4bfd-96fc-60b4f237f15c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956b3010-d693-430e-b3ec-3a726a02382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-64c70bb9-c591-4c65-aad8-f80f4f143386-00e0884a-7017-4e8c-ac20-d20c08cd0b50" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Creating volume 00e0884a-7017-4e8c-ac20-d20c08cd0b50 from snapshot 64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-quobyte-00e0884a-7017-4e8c-ac20-d20c08cd0b50" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-00e0884a-7017-4e8c-ac20-d20c08cd0b50" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] snapshot: 64c70bb9-c591-4c65-aad8-f80f4f143386, volume: 00e0884a-7017-4e8c-ac20-d20c08cd0b50,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:33:18 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Volume volume-00eb086c-a167-4bfd-96fc-60b4f237f15c (00eb086c-a167-4bfd-96fc-60b4f237f15c): created successfully
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956b3010-d693-430e-b3ec-3a726a02382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (4e9510b6-a8f2-4068-bcb6-affb2d9516e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b22b7699-4162-4612-b44f-04bbc6e915c9 tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d906770f-255e-46fa-ab13-4e93cb99a0dd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:18 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386
Sep 11 06:33:18 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:18 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386" returned: 0 in 0.423s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b575da1-53cf-49cd-91f3-47146e64808e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:19 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88
Sep 11 06:33:19 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:19 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" returned: 0 in 0.388s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:33:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:33:19 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:33:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:19 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50
Sep 11 06:33:19 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:24 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50" returned: 0 in 4.741s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:33:24 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Converted 1024.00 MB image at 215.94 MB/s
Sep 11 06:33:24 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 is being set with open permissions: ugo+rw
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:24 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50
Sep 11 06:33:24 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:24 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50" returned: 0 in 0.250s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-00e0884a-7017-4e8c-ac20-d20c08cd0b50" released by "_copy_volume_from_snapshot" :: held 5.902s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-64c70bb9-c591-4c65-aad8-f80f4f143386-00e0884a-7017-4e8c-ac20-d20c08cd0b50" released by "_create_volume_from_snapshot" :: held 5.974s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.718s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Creating offline snapshot b6b0b377-01cd-4782-b28f-06f225d263fd of volume 00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e9f2ce-f48d-41f0-858f-25ed22adac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50', 'volume_size': 1, 'snapshot_id': '64c70bb9-c591-4c65-aad8-f80f4f143386'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8b3ce5-ce3b-4236-be65-4ec9b0c06e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d431418f-4885-4db7-bc19-0dbf84710738]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:24 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Volume volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 (00e0884a-7017-4e8c-ac20-d20c08cd0b50): created successfully
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8b3ce5-ce3b-4236-be65-4ec9b0c06e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Flow 'volume_create_manager' (abfe12ae-f414-4e03-b617-a3fd77fcea3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:24 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d0f1f70e-f5e0-4b77-9ab3-228e20dfd045 tempest-VolumeDependencyTests-1663826767 None] Created volume successfully.
Sep 11 06:33:24 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c
Sep 11 06:33:24 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-64c70bb9-c591-4c65-aad8-f80f4f143386-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-64c70bb9-c591-4c65-aad8-f80f4f143386-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-quobyte-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-quobyte-64c70bb9-c591-4c65-aad8-f80f4f143386" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-64c70bb9-c591-4c65-aad8-f80f4f143386" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Deleting offline snapshot 64c70bb9-c591-4c65-aad8-f80f4f143386 of volume cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] snapshot_file for this snap is: volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01c2988-18a9-45f6-b30c-7b29cf6bf78f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:24 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c" returned: 0 in 0.403s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:24 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386
Sep 11 06:33:24 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:24 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd 1G
Sep 11 06:33:24 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:25 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386" returned: 0 in 0.416s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38263d7-3881-405e-bdbb-4963cf4ff519]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:25 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88
Sep 11 06:33:25 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:25 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd 1G" returned: 0 in 0.462s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00eb086c-a167-4bfd-96fc-60b4f237f15c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:25 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00eb086c-a167-4bfd-96fc-60b4f237f15c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd
Sep 11 06:33:25 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:25 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00eb086c-a167-4bfd-96fc-60b4f237f15c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd" returned: 0 in 0.331s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:25 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd is being set with open permissions: ugo+rw
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:25 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd
Sep 11 06:33:25 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:25 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" returned: 0 in 0.601s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:25 devstack sudo[106011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386
Sep 11 06:33:25 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:25 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=210,cinder:UPDATE=282,cinder:INSERT=71,cinder:DELETE=19 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=200,cinder:UPDATE=273,cinder:INSERT=77,cinder:DELETE=32 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:33:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:25 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.info
Sep 11 06:33:25 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:26 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386" returned: 0 in 0.395s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:26 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386
Sep 11 06:33:26 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:26 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.info" returned: 0 in 0.295s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:26 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.info is being set with open permissions: ugo+rw
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:26 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.info
Sep 11 06:33:26 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:26 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88.64c70bb9-c591-4c65-aad8-f80f4f143386" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-64c70bb9-c591-4c65-aad8-f80f4f143386" released by "_delete_snapshot" :: held 1.795s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" released by "delete_snapshot" :: held 1.824s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:26 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Created reservations ['bc4cf4cc-e162-4ba3-8ef0-b7535f877f24', 'efd59392-4e37-4e44-b9de-3340c368b58a', 'f477f897-94e1-4be4-8449-8526ad62b909', 'a8bec56a-d381-4c3c-a963-60e86c4bde83'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.info" returned: 0 in 0.307s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cd554da7-32d9-4cb4-9bfa-810476db5f2c tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:33:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Delete snapshot completed successfully.
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-05c7ac6d-3d4a-45fd-9b7f-6b737185bef8 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-64c70bb9-c591-4c65-aad8-f80f4f143386-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-quobyte-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa179c-a8f1-4f7e-9619-46c42d016c84]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:27 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88
Sep 11 06:33:27 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-b6b0b377-01cd-4782-b28f-06f225d263fd-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Lock "cinder-b6b0b377-01cd-4782-b28f-06f225d263fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-00eb086c-a167-4bfd-96fc-60b4f237f15c" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-00eb086c-a167-4bfd-96fc-60b4f237f15c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-b6b0b377-01cd-4782-b28f-06f225d263fd" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-b6b0b377-01cd-4782-b28f-06f225d263fd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot b6b0b377-01cd-4782-b28f-06f225d263fd of volume 00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:27 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" returned: 0 in 0.373s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a54f1f-321f-4ba9-9a07-86596dbb7501]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:27 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88
Sep 11 06:33:27 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:27 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd
Sep 11 06:33:27 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:27 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88" released by "delete_volume" :: held 0.691s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Created reservations ['8a82ac74-16f6-4691-89f8-f1065fa9153a', '4bd42279-0b10-4afa-8203-5e1e5bdc439e', 'c7f01f09-4284-4985-8913-2400c39c9677', 'a710e951-23ed-4ee5-974c-f04833d3d9ac'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:27 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd" returned: 0 in 0.447s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00eb086c-a167-4bfd-96fc-60b4f237f15c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:27 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:27 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e636b-1cfc-47b3-b5e3-e58415fd659b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:27 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c
Sep 11 06:33:27 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-00e0884a-7017-4e8c-ac20-d20c08cd0b50-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:28 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.303s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Deleted volume successfully.
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-00e0884a-7017-4e8c-ac20-d20c08cd0b50-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-0c723837-53fb-4d2e-93b9-de98978278f4 tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-cdf09b2d-3683-4f34-9f1a-ffd5a8b9af88-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "cinder-quobyte-00e0884a-7017-4e8c-ac20-d20c08cd0b50" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-00e0884a-7017-4e8c-ac20-d20c08cd0b50" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ddd44d-e7e4-409b-9862-aa53261f1a74]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:28 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c" returned: 0 in 0.451s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:28 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50
Sep 11 06:33:28 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:28 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd
Sep 11 06:33:28 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:28 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50" returned: 0 in 0.391s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:28 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50
Sep 11 06:33:28 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:28 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd" returned: 0 in 0.364s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:28 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd
Sep 11 06:33:28 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:28 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00e0884a-7017-4e8c-ac20-d20c08cd0b50" returned: 0 in 0.265s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-quobyte-00e0884a-7017-4e8c-ac20-d20c08cd0b50" released by "delete_volume" :: held 0.716s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:28 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Created reservations ['deeec97f-ccfb-420e-9805-96bb08ab2ec1', 'c5a79705-760f-45bc-918d-4f913dc087aa', 'c4900604-cced-4f7f-a1c1-e6ac93016a3a', '4a105095-aa7b-4601-9995-bfaaf3ab8df9'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c.b6b0b377-01cd-4782-b28f-06f225d263fd" returned: 0 in 0.284s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-b6b0b377-01cd-4782-b28f-06f225d263fd" released by "_delete_snapshot" :: held 1.701s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-00eb086c-a167-4bfd-96fc-60b4f237f15c" released by "delete_snapshot" :: held 1.734s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:29 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:29 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Created reservations ['bf65f916-ad12-4b30-8e8b-f0688e511599', '9c91c746-b70b-4d93-bafb-b88d7d1ddfa0', '19760ba3-1706-4e98-9dc0-0d61cbeae60d', '17c4fd65-e61c-4aef-a629-68e3b5ed47ea'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2320039c-2020-4945-ae4e-75479f5cf3da tempest-ProjectMemberTests-716560810 None] Lock "cinder-b6b0b377-01cd-4782-b28f-06f225d263fd-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-00eb086c-a167-4bfd-96fc-60b4f237f15c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:29 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.455s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:29 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Deleted volume successfully.
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Lock "cinder-00eb086c-a167-4bfd-96fc-60b4f237f15c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1c4d8791-6bbb-4765-bdb6-b281d1d6505f tempest-VolumeDependencyTests-1663826767 None] Lock "cinder-00e0884a-7017-4e8c-ac20-d20c08cd0b50-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-00eb086c-a167-4bfd-96fc-60b4f237f15c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-00eb086c-a167-4bfd-96fc-60b4f237f15c" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[91abb2b8-1d3e-4154-a369-b9752127ebde]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:29 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c
Sep 11 06:33:29 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:30 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c" returned: 0 in 0.400s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:30 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c
Sep 11 06:33:30 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:30 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-00eb086c-a167-4bfd-96fc-60b4f237f15c" returned: 0 in 0.284s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-00eb086c-a167-4bfd-96fc-60b4f237f15c" released by "delete_volume" :: held 0.778s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Created reservations ['1ec64e6b-bb1a-4217-93e5-713c7c61f120', '83f8c574-6ec9-4869-b4ac-44ee9878ef9c', 'd3be306e-ba1e-49b5-8bf1-e7c54523791f', 'c144ebaf-699c-48c2-9eef-85ebdca6a823'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:30 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:30 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:30 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.347s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:30 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:33:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-fddda339-24fc-4630-8e09-b9e457a61929 tempest-ProjectMemberTests-716560810 None] Lock "cinder-00eb086c-a167-4bfd-96fc-60b4f237f15c-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:31 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:31 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (9a12f8ef-3ff3-4e2d-bbf6-70971bdf2722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6e574b-8d52-4787-92f6-bfe5e42230f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6e574b-8d52-4787-92f6-bfe5e42230f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783404025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414051ac-b2db-4705-840b-9448139f8bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:31Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99d0ff9-fd8e-4995-994f-2c827e0f72cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99d0ff9-fd8e-4995-994f-2c827e0f72cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c924df72-63fb-4475-a4bb-abc98db12370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c924df72-63fb-4475-a4bb-abc98db12370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414051ac-b2db-4705-840b-9448139f8bc8', 'volume_name': 'volume-414051ac-b2db-4705-840b-9448139f8bc8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf8ab21-2293-4d35-91ec-27e9f1041701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf8ab21-2293-4d35-91ec-27e9f1041701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e3521f-c459-4950-993a-901a95e64c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:31 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Volume 414051ac-b2db-4705-840b-9448139f8bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414051ac-b2db-4705-840b-9448139f8bc8', 'volume_size': 1}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783404025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414051ac-b2db-4705-840b-9448139f8bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:31Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Creating volume 414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:31 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:31 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.267s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:33:31 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 1073741824
Sep 11 06:33:31 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:31 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 1073741824" returned: 0 in 0.556s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:32 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8
Sep 11 06:33:32 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:32 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8" returned: 0 in 0.312s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e3521f-c459-4950-993a-901a95e64c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414051ac-b2db-4705-840b-9448139f8bc8', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccb2103-0bf4-4351-87d2-eceae2f444ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Volume volume-414051ac-b2db-4705-840b-9448139f8bc8 (414051ac-b2db-4705-840b-9448139f8bc8): created successfully
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccb2103-0bf4-4351-87d2-eceae2f444ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (9a12f8ef-3ff3-4e2d-bbf6-70971bdf2722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:32 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-257442e1-863a-40f1-90cf-3c89f97a8b39 tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:33:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Creating offline snapshot ee2874e5-3ac9-4607-b3e9-847ac98aba65 of volume 414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:33 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b948aa-d1cd-4b01-a9ae-55e9a769fd9e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:33 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8
Sep 11 06:33:33 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:34 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8" returned: 0 in 0.477s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:34 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 1G
Sep 11 06:33:34 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:34 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 1G" returned: 0 in 0.635s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414051ac-b2db-4705-840b-9448139f8bc8 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:34 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414051ac-b2db-4705-840b-9448139f8bc8 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65
Sep 11 06:33:34 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:35 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414051ac-b2db-4705-840b-9448139f8bc8 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65" returned: 0 in 0.510s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:35 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 is being set with open permissions: ugo+rw
Sep 11 06:33:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:35 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65
Sep 11 06:33:35 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:35 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65" returned: 0 in 0.345s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:35 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.info
Sep 11 06:33:35 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:35 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.info" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:35 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.info is being set with open permissions: ugo+rw
Sep 11 06:33:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:35 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.info
Sep 11 06:33:35 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:36 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.info" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.646s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b9ea5021-4bdf-4c04-84f6-d5f32cc608b1 tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-ee2874e5-3ac9-4607-b3e9-847ac98aba65-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Lock "cinder-ee2874e5-3ac9-4607-b3e9-847ac98aba65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-414051ac-b2db-4705-840b-9448139f8bc8" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-414051ac-b2db-4705-840b-9448139f8bc8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-ee2874e5-3ac9-4607-b3e9-847ac98aba65" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-ee2874e5-3ac9-4607-b3e9-847ac98aba65" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot ee2874e5-3ac9-4607-b3e9-847ac98aba65 of volume 414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c2f832-b604-47a6-8a6f-63292c2c6362]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:37 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65
Sep 11 06:33:37 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:37 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65" returned: 0 in 0.489s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-414051ac-b2db-4705-840b-9448139f8bc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c61e2-8c1d-4801-9c00-dd10e0058c98]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:37 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8
Sep 11 06:33:37 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:37 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8" returned: 0 in 0.388s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:37 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65
Sep 11 06:33:37 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:38 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65" returned: 0 in 0.367s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:38 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65
Sep 11 06:33:38 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:38 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8.ee2874e5-3ac9-4607-b3e9-847ac98aba65" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-ee2874e5-3ac9-4607-b3e9-847ac98aba65" released by "_delete_snapshot" :: held 1.641s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-414051ac-b2db-4705-840b-9448139f8bc8" released by "delete_snapshot" :: held 1.677s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Created reservations ['067b04f1-6fc7-4abd-b8a4-c071af678ee4', 'bc1a548a-027e-4d53-a7d7-3f655b8bb2a1', 'e9dea251-e56f-43e9-9209-057bd8add9b4', 'f62bdabf-2524-4623-8300-914005e8ad37'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:38 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-4c691825-8304-4c3c-9303-4a8e32d32c9b tempest-ProjectMemberTests-716560810 None] Lock "cinder-ee2874e5-3ac9-4607-b3e9-847ac98aba65-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (56f471a0-fcbf-4c9e-9b4c-442fc86aebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81a3023-47d6-44a2-b2b5-a744b26cc2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81a3023-47d6-44a2-b2b5-a744b26cc2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085283217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac3d795-0fde-41a9-b7f5-dfa9316f8d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:39Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:38 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fa686d-8e52-4469-b2cf-ab72cde10222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fa686d-8e52-4469-b2cf-ab72cde10222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50b6fa0-b92e-49a8-9f78-ebb95597738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50b6fa0-b92e-49a8-9f78-ebb95597738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac3d795-0fde-41a9-b7f5-dfa9316f8d8a', 'volume_name': 'volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1003a3fe-06f5-4746-91c9-02e1dd413a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1003a3fe-06f5-4746-91c9-02e1dd413a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a27959-d92f-4bee-8031-ae4ae22e405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:39 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Volume aac3d795-0fde-41a9-b7f5-dfa9316f8d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a', 'volume_size': 1}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085283217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac3d795-0fde-41a9-b7f5-dfa9316f8d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:39Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Creating volume aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:39 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-414051ac-b2db-4705-840b-9448139f8bc8-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:39 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a 1073741824
Sep 11 06:33:39 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Lock "cinder-414051ac-b2db-4705-840b-9448139f8bc8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-414051ac-b2db-4705-840b-9448139f8bc8" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-414051ac-b2db-4705-840b-9448139f8bc8" acquired by "delete_volume" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ef2bd-15c1-488f-b517-cca73571e6d1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:39 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8
Sep 11 06:33:39 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:39 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a 1073741824" returned: 0 in 0.408s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:39 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a
Sep 11 06:33:39 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:39 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8" returned: 0 in 0.387s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:39 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8
Sep 11 06:33:39 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:39 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" returned: 0 in 0.271s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a27959-d92f-4bee-8031-ae4ae22e405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8660da86-131a-4b9d-842d-e444638c574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:39 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Volume volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a (aac3d795-0fde-41a9-b7f5-dfa9316f8d8a): created successfully
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8660da86-131a-4b9d-842d-e444638c574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (56f471a0-fcbf-4c9e-9b4c-442fc86aebe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:39 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-414051ac-b2db-4705-840b-9448139f8bc8" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:39 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-bfaa1994-4f81-4b47-b1a7-69aea8928111 tempest-ProjectReaderTests-1260733943 None] Created volume successfully.
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-414051ac-b2db-4705-840b-9448139f8bc8" released by "delete_volume" :: held 0.739s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:39 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Created reservations ['2f0f8cbe-7108-447d-bee9-571d7881bd02', '8e87aba5-93a6-46b6-b206-84f6fe0d93d0', '88ad2fe5-3b35-44ca-a567-1b3c1685142c', 'd9aeb4ec-0d27-4006-bba9-407652dc28e3'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:40 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:40 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Creating offline snapshot 65509a4d-6409-47bc-b427-b76997b2a043 of volume aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260450e-fa06-4b3d-b479-641d6da66643]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:40 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2b7ed08b-c5f7-4aef-bf12-39ace13085ae tempest-ProjectMemberTests-716560810 None] Lock "cinder-414051ac-b2db-4705-840b-9448139f8bc8-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:40 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a
Sep 11 06:33:40 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (f5e89503-b3ad-4d43-baaa-82efa9481d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:40 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1180c1-6d83-43ef-a742-b90139e567fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" returned: 0 in 0.430s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1180c1-6d83-43ef-a742-b90139e567fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874486242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918c26e9-cd1c-416a-afc6-a079e2796f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:41Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:40 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 1G
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d75fe22-5e26-49ea-bfa4-e1a1ed7adaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:40 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d75fe22-5e26-49ea-bfa4-e1a1ed7adaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b85a5e-9214-41ef-8a34-06d1e76d0476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b85a5e-9214-41ef-8a34-06d1e76d0476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918c26e9-cd1c-416a-afc6-a079e2796f71', 'volume_name': 'volume-918c26e9-cd1c-416a-afc6-a079e2796f71', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c136a883-a820-4028-9511-2fa8a9ef2ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c136a883-a820-4028-9511-2fa8a9ef2ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0754a87-7aa6-46c7-8731-356bd146c64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:40 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Volume 918c26e9-cd1c-416a-afc6-a079e2796f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918c26e9-cd1c-416a-afc6-a079e2796f71', 'volume_size': 1}
Sep 11 06:33:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:41 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 1G" returned: 0 in 0.496s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:41 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043
Sep 11 06:33:41 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:41 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043" returned: 0 in 0.409s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:41 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 is being set with open permissions: ugo+rw
Sep 11 06:33:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:41 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043
Sep 11 06:33:41 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:41 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:41 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043" returned: 0 in 0.273s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:42 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.info
Sep 11 06:33:42 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:42 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.info" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:42 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.info is being set with open permissions: ugo+rw
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:42 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.info
Sep 11 06:33:42 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:42 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.info" returned: 0 in 0.247s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.698s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874486242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918c26e9-cd1c-416a-afc6-a079e2796f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:41Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Creating volume 918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:42 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:42 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:42 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 1073741824
Sep 11 06:33:42 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:42 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e67d835a-c9e0-4255-9d2d-8e2f142817e0 tempest-ProjectReaderTests-1260733943 None] Create snapshot completed successfully
Sep 11 06:33:43 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 1073741824" returned: 0 in 0.488s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:43 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71
Sep 11 06:33:43 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:43 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71" returned: 0 in 0.251s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0754a87-7aa6-46c7-8731-356bd146c64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918c26e9-cd1c-416a-afc6-a079e2796f71', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bed7aa-0873-42c5-968d-ec6c73bf0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:43 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Volume volume-918c26e9-cd1c-416a-afc6-a079e2796f71 (918c26e9-cd1c-416a-afc6-a079e2796f71): created successfully
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bed7aa-0873-42c5-968d-ec6c73bf0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (f5e89503-b3ad-4d43-baaa-82efa9481d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:43 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a2e333ba-88f8-4f05-9028-abf41ee17ab5 tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-65509a4d-6409-47bc-b427-b76997b2a043-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-65509a4d-6409-47bc-b427-b76997b2a043-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-65509a4d-6409-47bc-b427-b76997b2a043" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-65509a4d-6409-47bc-b427-b76997b2a043" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Deleting offline snapshot 65509a4d-6409-47bc-b427-b76997b2a043 of volume aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] snapshot_file for this snap is: volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c0398-82e4-46df-99bb-8796c792c269]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:43 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:43 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043
Sep 11 06:33:43 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Creating offline snapshot a34ea51c-2c2a-4125-b103-7bfd8b5989cd of volume 918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:44 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043" returned: 0 in 0.494s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f925d6b3-7bf5-4a32-a817-52844e1219a1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d91bb8-a66a-40bf-ba87-8d553fc1e108]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:44 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71
Sep 11 06:33:44 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:44 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a
Sep 11 06:33:44 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:44 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" returned: 0 in 0.391s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:44 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71" returned: 0 in 0.416s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:44 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:44 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043
Sep 11 06:33:44 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:44 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd 1G
Sep 11 06:33:44 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:45 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043" returned: 0 in 0.389s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:45 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043
Sep 11 06:33:45 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:45 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd 1G" returned: 0 in 0.481s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918c26e9-cd1c-416a-afc6-a079e2796f71 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:45 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918c26e9-cd1c-416a-afc6-a079e2796f71 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd
Sep 11 06:33:45 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:45 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a.65509a4d-6409-47bc-b427-b76997b2a043" returned: 0 in 0.298s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-65509a4d-6409-47bc-b427-b76997b2a043" released by "_delete_snapshot" :: held 1.684s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" released by "delete_snapshot" :: held 1.710s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Created reservations ['6f386b78-6e33-4808-b346-5c7eb62c9279', '3a541a92-f4c0-45c3-9eff-8156233a6c0f', '35c7bace-715e-4163-884e-8ccea73074df', '29107e8b-b6c3-4630-b930-2c82134427e5'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:45 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918c26e9-cd1c-416a-afc6-a079e2796f71 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd" returned: 0 in 0.353s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:45 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd is being set with open permissions: ugo+rw
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:45 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Delete snapshot completed successfully.
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-56fdeeb2-2ae2-43de-96ac-a37e09038c65 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-65509a4d-6409-47bc-b427-b76997b2a043-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:45 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd
Sep 11 06:33:45 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:45 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd" returned: 0 in 0.256s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:45 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.info
Sep 11 06:33:45 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b7f9e2-5087-44ad-b0a5-15c00d6dbbd8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:45 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:46 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.info" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:46 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.info is being set with open permissions: ugo+rw
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:46 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a
Sep 11 06:33:46 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:46 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.info
Sep 11 06:33:46 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:46 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.info" returned: 0 in 0.305s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:46 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-41162fa1-b381-415d-a3d4-8566cf98bc56 tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:33:46 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" returned: 0 in 0.490s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:46 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a
Sep 11 06:33:46 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:46 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" returned: 0 in 0.263s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a" released by "delete_volume" :: held 0.823s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Created reservations ['9c3c60e4-0d05-4131-b6ed-2f02ae2cef8b', '14279a17-06ce-4bcf-83f8-7be301484e83', '83fe19f9-4950-469d-9474-aeebf0157317', '7f3b8316-29ce-4258-9bea-1481adbb0265'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:46 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:46 devstack sudo[106290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:46 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:47 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:47 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Deleted volume successfully.
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-57280da7-1ee1-4fdd-b225-b0b0c510d649 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-aac3d795-0fde-41a9-b7f5-dfa9316f8d8a-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-a34ea51c-2c2a-4125-b103-7bfd8b5989cd-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Lock "cinder-a34ea51c-2c2a-4125-b103-7bfd8b5989cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-918c26e9-cd1c-416a-afc6-a079e2796f71" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-918c26e9-cd1c-416a-afc6-a079e2796f71" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-a34ea51c-2c2a-4125-b103-7bfd8b5989cd" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-a34ea51c-2c2a-4125-b103-7bfd8b5989cd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot a34ea51c-2c2a-4125-b103-7bfd8b5989cd of volume 918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daca75d-1776-41cd-8769-0adcea1f0aae]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:47 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd
Sep 11 06:33:47 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (2e82cd6d-67e9-4af6-8f22-d532ed75c836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d7ac3b-3cd6-4af4-b2e2-b5ce0d5a9528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d7ac3b-3cd6-4af4-b2e2-b5ce0d5a9528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139371529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6f5061-54ad-4ffb-ba13-f936efa44ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:48Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b4eb7-9c2c-4c31-a7ce-268a8b833215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b4eb7-9c2c-4c31-a7ce-268a8b833215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be83c97d-d787-4a1e-aec1-ee2cda668774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be83c97d-d787-4a1e-aec1-ee2cda668774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6f5061-54ad-4ffb-ba13-f936efa44ae1', 'volume_name': 'volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6095bca4-ce24-419c-916a-623b01409f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6095bca4-ce24-419c-916a-623b01409f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aeda10-d441-45d0-91b8-5078c588273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:47 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Volume 6e6f5061-54ad-4ffb-ba13-f936efa44ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1', 'volume_size': 1}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139371529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6f5061-54ad-4ffb-ba13-f936efa44ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:48Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Creating volume 6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:47 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:47 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:47 devstack sudo[106295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 1073741824
Sep 11 06:33:47 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:48 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd" returned: 0 in 0.499s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918c26e9-cd1c-416a-afc6-a079e2796f71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5731d71-9d0e-42a8-8a35-edbf0ce29420]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:48 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71
Sep 11 06:33:48 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:48 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 1073741824" returned: 0 in 0.568s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:48 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1
Sep 11 06:33:48 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:48 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71" returned: 0 in 0.409s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:48 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd
Sep 11 06:33:48 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:48 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" returned: 0 in 0.294s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aeda10-d441-45d0-91b8-5078c588273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d28e1-a883-4f71-b75f-52497997c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:48 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Volume volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 (6e6f5061-54ad-4ffb-ba13-f936efa44ae1): created successfully
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d28e1-a883-4f71-b75f-52497997c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (2e82cd6d-67e9-4af6-8f22-d532ed75c836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:48 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1ae4a847-19e5-46de-b917-bd13c723eb25 tempest-ProjectReaderTests-1260733943 None] Created volume successfully.
Sep 11 06:33:48 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd" returned: 0 in 0.424s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:48 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd
Sep 11 06:33:48 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Flow 'volume_create_manager' (b44bcb14-1f6d-4f1a-98e0-92e21c64672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1cdb8e-9098-418c-add0-a0136a63e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1cdb8e-9098-418c-add0-a0136a63e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1182148724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf48b303-7534-47dd-840f-aabba0c30af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51535cc1709849fdaca20b8b44eb8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:49Z,use_quota=True,user_id='ae1e42edbc1842cc8fa8b3a51f814541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87876242-0d93-436f-ac00-66649de9d1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87876242-0d93-436f-ac00-66649de9d1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:48 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08710cbb-4388-45a8-9144-09191888507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08710cbb-4388-45a8-9144-09191888507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf48b303-7534-47dd-840f-aabba0c30af7', 'volume_name': 'volume-cf48b303-7534-47dd-840f-aabba0c30af7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928f8d9a-168e-41df-b80b-1705936e718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928f8d9a-168e-41df-b80b-1705936e718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6150cee4-b4fc-4c27-80ce-5b985525692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Volume cf48b303-7534-47dd-840f-aabba0c30af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf48b303-7534-47dd-840f-aabba0c30af7', 'volume_size': 1}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1182148724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf48b303-7534-47dd-840f-aabba0c30af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51535cc1709849fdaca20b8b44eb8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:49Z,use_quota=True,user_id='ae1e42edbc1842cc8fa8b3a51f814541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Creating volume cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:49 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:49 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 1073741824
Sep 11 06:33:49 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:49 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71.a34ea51c-2c2a-4125-b103-7bfd8b5989cd" returned: 0 in 0.257s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-a34ea51c-2c2a-4125-b103-7bfd8b5989cd" released by "_delete_snapshot" :: held 1.689s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-918c26e9-cd1c-416a-afc6-a079e2796f71" released by "delete_snapshot" :: held 1.714s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Created reservations ['4891e993-497e-4d2d-b977-878f5237f280', 'a78adca2-4442-473f-affb-3653777d23fb', 'b073382c-b056-4c64-bdbf-2048e585e9ab', '0edc04c3-74d2-4585-a4ad-25a4ecb65703'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:49 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f56b1528-f80f-4873-823a-f46fad5e039f tempest-ProjectMemberTests-716560810 None] Lock "cinder-a34ea51c-2c2a-4125-b103-7bfd8b5989cd-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:49 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 1073741824" returned: 0 in 0.430s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:49 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7
Sep 11 06:33:49 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-918c26e9-cd1c-416a-afc6-a079e2796f71-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Lock "cinder-918c26e9-cd1c-416a-afc6-a079e2796f71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-918c26e9-cd1c-416a-afc6-a079e2796f71" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-918c26e9-cd1c-416a-afc6-a079e2796f71" acquired by "delete_volume" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:49 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7" returned: 0 in 0.275s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d8115d-628e-4f08-a655-df379fc1b4c3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6150cee4-b4fc-4c27-80ce-5b985525692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf48b303-7534-47dd-840f-aabba0c30af7', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e8b47-9163-4552-a63d-6ebc7d5cf5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:49 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Volume volume-cf48b303-7534-47dd-840f-aabba0c30af7 (cf48b303-7534-47dd-840f-aabba0c30af7): created successfully
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e8b47-9163-4552-a63d-6ebc7d5cf5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Flow 'volume_create_manager' (b44bcb14-1f6d-4f1a-98e0-92e21c64672e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:49 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c5d0b1b9-4b86-41e5-b42f-f13abe5ae468 tempest-SnapshotDependencyTests-825982225 None] Created volume successfully.
Sep 11 06:33:49 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71
Sep 11 06:33:49 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:49 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Creating offline snapshot 52fb39e3-9eec-4b8f-8f40-fcff2d2624aa of volume 6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4e2c7-56d9-4f11-881b-dded4815bf1d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:50 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1
Sep 11 06:33:50 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:50 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71" returned: 0 in 0.393s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:50 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71
Sep 11 06:33:50 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:50 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" returned: 0 in 0.360s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:50 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa 1G
Sep 11 06:33:50 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:50 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-918c26e9-cd1c-416a-afc6-a079e2796f71" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-918c26e9-cd1c-416a-afc6-a079e2796f71" released by "delete_volume" :: held 0.704s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Created reservations ['2e7f01fb-ca62-4f3f-9ca4-69c6218aecd8', '53a08b45-4047-42a9-a888-f9f8e9b99b72', '67c724d5-441d-47a7-beb4-02eda6c212ae', '56de46ec-f516-4ab2-be3c-a4cf2dbfa287'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:50 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:50 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:50 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa 1G" returned: 0 in 0.398s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:50 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa
Sep 11 06:33:50 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:50 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.266s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:50 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:33:50 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a23122ac-3e3d-41e9-b9a1-489604eeebf0 tempest-ProjectMemberTests-716560810 None] Lock "cinder-918c26e9-cd1c-416a-afc6-a079e2796f71-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:51 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" returned: 0 in 0.340s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:51 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa is being set with open permissions: ugo+rw
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:51 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa
Sep 11 06:33:51 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:51 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" returned: 0 in 0.285s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (60e96c4b-f19b-4d37-a6eb-8370e58b9345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b6c9b-6023-4b57-9992-aab52cf0ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81b6c9b-6023-4b57-9992-aab52cf0ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665642446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018e7d79-4d91-4b1c-8615-832614b15f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:51Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:51 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.info
Sep 11 06:33:51 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d20d106-a355-4331-bb77-3c65cea490c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d20d106-a355-4331-bb77-3c65cea490c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b48926-15e8-4d13-82f5-0cb5f83e3f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b48926-15e8-4d13-82f5-0cb5f83e3f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018e7d79-4d91-4b1c-8615-832614b15f03', 'volume_name': 'volume-018e7d79-4d91-4b1c-8615-832614b15f03', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab951d3-b9f9-4a3f-82bd-d21070e6de89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab951d3-b9f9-4a3f-82bd-d21070e6de89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06baad35-cc8d-4f7a-9aeb-68bf102be06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:51 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Volume 018e7d79-4d91-4b1c-8615-832614b15f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018e7d79-4d91-4b1c-8615-832614b15f03', 'volume_size': 1}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:51 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.info" returned: 0 in 0.247s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:51 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.info is being set with open permissions: ugo+rw
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:51 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.info
Sep 11 06:33:51 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:51 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.info" returned: 0 in 0.248s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665642446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018e7d79-4d91-4b1c-8615-832614b15f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:51Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Creating volume 018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:51 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:33:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:52 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 1073741824
Sep 11 06:33:52 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e1d461c8-7a20-4204-93e6-1d2c1cc71e03 tempest-ProjectReaderTests-1260733943 None] Create snapshot completed successfully
Sep 11 06:33:52 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 1073741824" returned: 0 in 0.438s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:52 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03
Sep 11 06:33:52 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:52 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03" returned: 0 in 0.254s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.181s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06baad35-cc8d-4f7a-9aeb-68bf102be06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018e7d79-4d91-4b1c-8615-832614b15f03', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0894bc-1962-438f-919e-763b64668d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Creating offline snapshot 1a9dc5b0-e779-404f-b364-a86d845c60f0 of volume cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:52 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Volume volume-018e7d79-4d91-4b1c-8615-832614b15f03 (018e7d79-4d91-4b1c-8615-832614b15f03): created successfully
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0894bc-1962-438f-919e-763b64668d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (60e96c4b-f19b-4d37-a6eb-8370e58b9345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43256ff-08fa-4d5f-b7d3-c31c742ee1d6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-24529886-20f5-41f5-bd5b-e8f45361feb4 tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:33:52 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7
Sep 11 06:33:52 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-52fb39e3-9eec-4b8f-8f40-fcff2d2624aa-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:53 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7" returned: 0 in 0.386s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-52fb39e3-9eec-4b8f-8f40-fcff2d2624aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:53 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 1G
Sep 11 06:33:53 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Deleting offline snapshot 52fb39e3-9eec-4b8f-8f40-fcff2d2624aa of volume 6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] snapshot_file for this snap is: volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[536da546-bb87-40ef-a838-894b3a8739ef]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:53 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa
Sep 11 06:33:53 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:53 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" returned: 0 in 0.393s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:53 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 1G" returned: 0 in 0.505s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf48b303-7534-47dd-840f-aabba0c30af7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbdd67f-faa6-4192-b4ad-d408b5116563]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:53 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf48b303-7534-47dd-840f-aabba0c30af7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0
Sep 11 06:33:53 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:53 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1
Sep 11 06:33:53 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:53 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf48b303-7534-47dd-840f-aabba0c30af7 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0" returned: 0 in 0.295s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:53 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 is being set with open permissions: ugo+rw
Sep 11 06:33:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:53 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0
Sep 11 06:33:53 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:54 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" returned: 0 in 0.379s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:54 devstack sudo[106401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa
Sep 11 06:33:54 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:54 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0" returned: 0 in 0.252s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:54 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.info
Sep 11 06:33:54 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:54 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" returned: 0 in 0.351s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:54 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa
Sep 11 06:33:54 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:54 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.info" returned: 0 in 0.274s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:54 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.info is being set with open permissions: ugo+rw
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:54 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.info
Sep 11 06:33:54 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:54 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1.52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" returned: 0 in 0.261s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-52fb39e3-9eec-4b8f-8f40-fcff2d2624aa" released by "_delete_snapshot" :: held 1.479s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" released by "delete_snapshot" :: held 1.504s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Created reservations ['2de5e8e5-7984-4af9-beee-2d19e942c06e', 'e4ebecc5-9ba4-4afd-b53d-6c856761a78c', 'ea8ac1f0-db72-4776-8e6f-f01bc28ee9ef', '41daed29-adfe-4a8f-9186-a1c7299e9154'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:54 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.info" returned: 0 in 0.255s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.206s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Creating offline snapshot fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b of volume 018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:33:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9772867c-4f41-4586-8159-39fda0b65a72 tempest-SnapshotDependencyTests-825982225 None] Create snapshot completed successfully
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6800bbd3-435d-42ca-a7e2-7922fc1762f3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Delete snapshot completed successfully.
Sep 11 06:33:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b365c0ac-3371-4bca-9f7c-3e42ceb48798 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-52fb39e3-9eec-4b8f-8f40-fcff2d2624aa-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:54 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03
Sep 11 06:33:54 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:55 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03" returned: 0 in 0.362s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:55 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b 1G
Sep 11 06:33:55 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-6e6f5061-54ad-4ffb-ba13-f936efa44ae1-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-6e6f5061-54ad-4ffb-ba13-f936efa44ae1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bdc42a-338b-43a3-ad80-f75e490fd9c7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:55 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1
Sep 11 06:33:55 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:55 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b 1G" returned: 0 in 0.501s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018e7d79-4d91-4b1c-8615-832614b15f03 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:55 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018e7d79-4d91-4b1c-8615-832614b15f03 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b
Sep 11 06:33:55 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:55 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" returned: 0 in 0.435s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:55 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1
Sep 11 06:33:55 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:56 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018e7d79-4d91-4b1c-8615-832614b15f03 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" returned: 0 in 0.370s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:56 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b is being set with open permissions: ugo+rw
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:56 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b
Sep 11 06:33:56 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:56 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-6e6f5061-54ad-4ffb-ba13-f936efa44ae1" released by "delete_volume" :: held 0.802s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Flow 'volume_create_manager' (fcbf1a4c-232d-4019-946b-9684721dfac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7708c366-3d0c-430b-b840-043eec68f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7708c366-3d0c-430b-b840-043eec68f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80820c6-16f9-4191-9bd4-ca6bf7efd86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51535cc1709849fdaca20b8b44eb8524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a9dc5b0-e779-404f-b364-a86d845c60f0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:56Z,use_quota=True,user_id='ae1e42edbc1842cc8fa8b3a51f814541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457956f3-4776-4304-8870-e8368697ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457956f3-4776-4304-8870-e8368697ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70c7805-0a72-4576-8ed6-518bb353d74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70c7805-0a72-4576-8ed6-518bb353d74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b80820c6-16f9-4191-9bd4-ca6bf7efd86d', 'volume_name': 'volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d', 'volume_size': 1, 'snapshot_id': '1a9dc5b0-e779-404f-b364-a86d845c60f0'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee913d0-f35a-4e36-88fa-a05b26bfd89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee913d0-f35a-4e36-88fa-a05b26bfd89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6ffb58-d1e2-4c45-b507-1574b6325bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:56 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Volume b80820c6-16f9-4191-9bd4-ca6bf7efd86d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d', 'volume_size': 1, 'snapshot_id': '1a9dc5b0-e779-404f-b364-a86d845c60f0'}
Sep 11 06:33:56 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Created reservations ['7e4c6bd5-5927-4661-a1ea-a5eb784ebcd7', 'a7fd25b5-de90-463a-bc3b-ffb6f36f64e5', '125f3ab1-2021-492e-bdf2-1a989ad4be22', '10e0644f-597e-45ef-8699-3e41843c008f'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" returned: 0 in 0.280s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:56 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.info
Sep 11 06:33:56 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:56 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:33:56 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:56 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.info" returned: 0 in 0.282s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:56 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.info is being set with open permissions: ugo+rw
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:56 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.info
Sep 11 06:33:56 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:56 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.274s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:33:56 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Deleted volume successfully.
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-94759ab9-6948-43d2-850b-9452c0b7b518 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-6e6f5061-54ad-4ffb-ba13-f936efa44ae1-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:33:56 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:56 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.info" returned: 0 in 0.299s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.649s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-quobyte-1a9dc5b0-e779-404f-b364-a86d845c60f0-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" by "_create_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (18818248-58e2-46e6-9293-6c130f871ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7809a6f-2d38-4a2d-a9b2-3bf53db79943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-1a9dc5b0-e779-404f-b364-a86d845c60f0-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Creating volume b80820c6-16f9-4191-9bd4-ca6bf7efd86d from snapshot 1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-quobyte-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" by "_copy_volume_from_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7809a6f-2d38-4a2d-a9b2-3bf53db79943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247681231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b540815-1eff-4c72-b92a-09104d7dcc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:57Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24746a-7caa-4d05-8b86-149068a43a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e24746a-7caa-4d05-8b86-149068a43a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ba7569-975c-49ea-ba3f-7a642a282407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ba7569-975c-49ea-ba3f-7a642a282407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b540815-1eff-4c72-b92a-09104d7dcc5b', 'volume_name': 'volume-0b540815-1eff-4c72-b92a-09104d7dcc5b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e88faf3-bcb7-4819-b89d-e4cd7c4fc910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e88faf3-bcb7-4819-b89d-e4cd7c4fc910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2627e2-548a-4652-a8c7-c307dcf29e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:33:57 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Volume 0b540815-1eff-4c72-b92a-09104d7dcc5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b540815-1eff-4c72-b92a-09104d7dcc5b', 'volume_size': 1}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:57 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-047d6232-0f81-4adb-be6d-cdb1c2179c3d tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] snapshot: 1a9dc5b0-e779-404f-b364-a86d845c60f0, volume: b80820c6-16f9-4191-9bd4-ca6bf7efd86d,  {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef175096-9357-4083-8a92-413c0f65ce8e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:57 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0
Sep 11 06:33:57 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:57 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0" returned: 0 in 0.342s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf48b303-7534-47dd-840f-aabba0c30af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5dbbff-2bf6-4312-877c-d9619fba995b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:57 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7
Sep 11 06:33:57 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Lock "cinder-fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-018e7d79-4d91-4b1c-8615-832614b15f03" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-018e7d79-4d91-4b1c-8615-832614b15f03" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b of volume 018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c329cc-ec15-4f44-b17f-ce48b4f94253]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:57 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7" returned: 0 in 0.393s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Creating direct copy from snapshot {{(pid=88109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG cinder.utils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Path /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d not found in is_blk_device check {{(pid=88109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 06:33:57 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:57 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d
Sep 11 06:33:57 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:58 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b
Sep 11 06:33:58 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:58 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" returned: 0 in 0.402s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:58 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-018e7d79-4d91-4b1c-8615-832614b15f03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:33:58 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4614c2-6234-4cdb-a3ac-243c76cacdbe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:33:58 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:58 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03
Sep 11 06:33:58 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:59 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03" returned: 0 in 0.824s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:59 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b
Sep 11 06:33:59 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:33:59 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 11 06:33:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" returned: 0 in 0.741s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:33:59 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:33:59 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b
Sep 11 06:33:59 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:00 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:00 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03.fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" returned: 0 in 0.616s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b" released by "_delete_snapshot" :: held 2.739s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-018e7d79-4d91-4b1c-8615-832614b15f03" released by "delete_snapshot" :: held 2.771s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:00 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Created reservations ['201a4d87-d82c-496c-952a-b0e0f042d082', '40218501-aa19-4b1d-a55d-6ae572bf8052', 'cc144e46-d0eb-4d78-a47a-d4a3d52e0fb4', '7a5d6c07-3c27-4b4c-9a44-6c6630f88d24'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:00 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:34:00 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a8ea2300-b09f-45e5-a8b1-c32b828619c7 tempest-ProjectMemberTests-716560810 None] Lock "cinder-fd4dbb95-2869-4baa-b80d-fb9f85d1cb0b-delete_snapshot" released by "delete_snapshot" :: held 3.160s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-018e7d79-4d91-4b1c-8615-832614b15f03-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Lock "cinder-018e7d79-4d91-4b1c-8615-832614b15f03-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-018e7d79-4d91-4b1c-8615-832614b15f03" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:01 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-018e7d79-4d91-4b1c-8615-832614b15f03" acquired by "delete_volume" :: waited 0.030s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:01 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99eb5cb-c7a4-48aa-b7b0-96f151b000be]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:01 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:01 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03
Sep 11 06:34:01 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:02 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03" returned: 0 in 0.779s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:02 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03
Sep 11 06:34:02 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:02 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" returned: 0 in 4.748s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.image.image_utils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d {{(pid=88109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 11 06:34:02 devstack cinder-volume[88109]: INFO cinder.image.image_utils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Converted 1024.00 MB image at 215.60 MB/s
Sep 11 06:34:02 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d is being set with open permissions: ugo+rw
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:02 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d
Sep 11 06:34:02 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:02 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-018e7d79-4d91-4b1c-8615-832614b15f03" returned: 0 in 0.424s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-018e7d79-4d91-4b1c-8615-832614b15f03" released by "delete_volume" :: held 1.309s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Created reservations ['b464f096-ce43-4b32-a9b9-22bc8271c942', '35c2d828-a550-4784-90d9-d7167a300d15', '42b02c90-4dfb-44a6-b910-09a555a9541c', '2ea1d1de-0b97-4974-8f01-d15c827f1336'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:02 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:02 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:02 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" released by "_copy_volume_from_snapshot" :: held 5.811s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-1a9dc5b0-e779-404f-b364-a86d845c60f0-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" released by "_create_volume_from_snapshot" :: held 5.926s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.980s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.872s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247681231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b540815-1eff-4c72-b92a-09104d7dcc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:33:57Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Creating volume 0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:03 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:03 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b 1073741824
Sep 11 06:34:03 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6ffb58-d1e2-4c45-b507-1574b6325bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d', 'volume_size': 1, 'snapshot_id': '1a9dc5b0-e779-404f-b364-a86d845c60f0'}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995bc92b-75bb-4908-adf1-a7f6e043b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Volume volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d (b80820c6-16f9-4191-9bd4-ca6bf7efd86d): created successfully
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995bc92b-75bb-4908-adf1-a7f6e043b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Flow 'volume_create_manager' (fcbf1a4c-232d-4019-946b-9684721dfac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1b755489-20e6-45c0-a5e9-2bb4c68ceb91 tempest-SnapshotDependencyTests-825982225 None] Created volume successfully.
Sep 11 06:34:03 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.249s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-6d799503-4317-4c9b-be61-71487fcac76b tempest-ProjectMemberTests-716560810 None] Lock "cinder-018e7d79-4d91-4b1c-8615-832614b15f03-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:03 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b 1073741824" returned: 0 in 0.417s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:03 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b
Sep 11 06:34:03 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:03 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b" returned: 0 in 0.242s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2627e2-548a-4652-a8c7-c307dcf29e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b540815-1eff-4c72-b92a-09104d7dcc5b', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b02b9-0225-49e6-8a3e-8fc30fcd0a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Volume volume-0b540815-1eff-4c72-b92a-09104d7dcc5b (0b540815-1eff-4c72-b92a-09104d7dcc5b): created successfully
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b02b9-0225-49e6-8a3e-8fc30fcd0a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (18818248-58e2-46e6-9293-6c130f871ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-9951caa2-5f20-4dd4-bd53-3bc3022eda32 tempest-ProjectReaderTests-1260733943 None] Created volume successfully.
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-1a9dc5b0-e779-404f-b364-a86d845c60f0-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-1a9dc5b0-e779-404f-b364-a86d845c60f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-quobyte-cf48b303-7534-47dd-840f-aabba0c30af7" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-cf48b303-7534-47dd-840f-aabba0c30af7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-quobyte-1a9dc5b0-e779-404f-b364-a86d845c60f0" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-1a9dc5b0-e779-404f-b364-a86d845c60f0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Deleting offline snapshot 1a9dc5b0-e779-404f-b364-a86d845c60f0 of volume cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] snapshot_file for this snap is: volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c621304-a94f-4056-95d4-8dd59c4eb9dc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:04 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0
Sep 11 06:34:04 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (210a4e2d-d52d-49d3-bd01-f43d8e0a1b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e2e851-3c48-4e5b-891e-68ed51fdf7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e2e851-3c48-4e5b-891e-68ed51fdf7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1455783968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4073f8e-a31d-4bf8-b30a-f28cae055fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:04Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a28f45d-f31c-467b-b51f-8949244d423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a28f45d-f31c-467b-b51f-8949244d423c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d4297-0cb5-472a-a460-a1d00d74c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d4297-0cb5-472a-a460-a1d00d74c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4073f8e-a31d-4bf8-b30a-f28cae055fe5', 'volume_name': 'volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7519f01f-e318-4bc4-bdc3-afc1f632452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7519f01f-e318-4bc4-bdc3-afc1f632452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c459bd4-9c2a-4d4b-a5bf-1abc4a410294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:04 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Volume e4073f8e-a31d-4bf8-b30a-f28cae055fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5', 'volume_size': 1}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1455783968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4073f8e-a31d-4bf8-b30a-f28cae055fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:04Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Creating volume e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:04 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:04 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 1073741824
Sep 11 06:34:04 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:04 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0" returned: 0 in 0.350s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf48b303-7534-47dd-840f-aabba0c30af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[060611f1-f592-4711-b95d-4d54774c954a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:04 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7
Sep 11 06:34:04 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:04 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 1073741824" returned: 0 in 0.445s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:04 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5
Sep 11 06:34:04 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:04 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" returned: 0 in 0.268s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.052s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c459bd4-9c2a-4d4b-a5bf-1abc4a410294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ceb8a2-68d2-4700-a101-ae64436fea7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Creating offline snapshot 01380f5d-e7ae-4b36-8627-11dc1036d919 of volume 0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:34:05 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7" returned: 0 in 0.629s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:05 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Volume volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 (e4073f8e-a31d-4bf8-b30a-f28cae055fe5): created successfully
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ceb8a2-68d2-4700-a101-ae64436fea7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (210a4e2d-d52d-49d3-bd01-f43d8e0a1b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b6be81-3122-46c4-87cb-35f8fd270a18]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:05 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0
Sep 11 06:34:05 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0287d52d-9273-4087-8946-f20c5881d9c7 tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:34:05 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b
Sep 11 06:34:05 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:05 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0" returned: 0 in 0.419s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:05 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0
Sep 11 06:34:05 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:05 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b" returned: 0 in 0.421s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:05 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 1G
Sep 11 06:34:05 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:05 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7.1a9dc5b0-e779-404f-b364-a86d845c60f0" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-1a9dc5b0-e779-404f-b364-a86d845c60f0" released by "_delete_snapshot" :: held 1.744s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-cf48b303-7534-47dd-840f-aabba0c30af7" released by "delete_snapshot" :: held 1.784s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Created reservations ['2f78ad50-5fe8-4965-8c73-65a224a2fe6b', '82f6f95d-1ba2-49d2-a8b9-c64854148504', 'd12498fb-49a4-49f0-9a58-d97a3636e70d', 'fcd28aa4-6280-4c29-ba89-3b8b52c0fa97'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:05 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Delete snapshot completed successfully.
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-eed902d2-16f9-49af-abd8-f4eb2df143f4 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-1a9dc5b0-e779-404f-b364-a86d845c60f0-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:05 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 1G" returned: 0 in 0.412s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b540815-1eff-4c72-b92a-09104d7dcc5b -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:05 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b540815-1eff-4c72-b92a-09104d7dcc5b -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919
Sep 11 06:34:05 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-cf48b303-7534-47dd-840f-aabba0c30af7-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-cf48b303-7534-47dd-840f-aabba0c30af7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-quobyte-cf48b303-7534-47dd-840f-aabba0c30af7" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-cf48b303-7534-47dd-840f-aabba0c30af7" acquired by "delete_volume" :: waited 0.013s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdc459a-e9cb-4897-8b3a-755802282a48]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:06 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b540815-1eff-4c72-b92a-09104d7dcc5b -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:06 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 is being set with open permissions: ugo+rw
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:06 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919
Sep 11 06:34:06 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:06 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7
Sep 11 06:34:06 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:06 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919" returned: 0 in 0.248s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:06 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.info
Sep 11 06:34:06 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:06 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7" returned: 0 in 0.357s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:06 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7
Sep 11 06:34:06 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:06 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.info" returned: 0 in 0.283s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:06 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.info is being set with open permissions: ugo+rw
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:06 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.info
Sep 11 06:34:06 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:06 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-cf48b303-7534-47dd-840f-aabba0c30af7" returned: 0 in 0.283s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-cf48b303-7534-47dd-840f-aabba0c30af7" released by "delete_volume" :: held 0.704s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:06 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Created reservations ['b98a2f75-9d1d-4e1d-82fd-f97999bbf708', '3651b0bb-603f-4f31-ae8d-440549fd124c', 'caf195da-81e7-44ac-b387-4c759d7fe349', 'dc16a022-aec2-4ca4-baef-a3f3bbb976f7'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:07 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:07 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:07 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.info" returned: 0 in 0.305s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.742s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Creating offline snapshot 5b5e0d98-e4a4-4f3b-97ed-00116271059f of volume e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3ff1ea-b380-4b96-ac64-584242142070]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f29b1d68-1859-45f6-978b-0d7a65dc5db6 tempest-ProjectReaderTests-1260733943 None] Create snapshot completed successfully
Sep 11 06:34:07 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:07 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-b80820c6-16f9-4191-9bd4-ca6bf7efd86d-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:07 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.271s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Deleted volume successfully.
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-b80820c6-16f9-4191-9bd4-ca6bf7efd86d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f136e0a2-9f6c-4340-92ab-1b5b8e995891 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-cf48b303-7534-47dd-840f-aabba0c30af7-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "cinder-quobyte-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb2da4-f2d1-4681-a7be-218009aafe9b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:07 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d
Sep 11 06:34:07 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:07 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" returned: 0 in 0.409s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:07 devstack sudo[106592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f 1G
Sep 11 06:34:07 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:07 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:07 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d
Sep 11 06:34:07 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:07 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f 1G" returned: 0 in 0.382s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:08 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f
Sep 11 06:34:08 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:08 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" returned: 0 in 0.270s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-quobyte-b80820c6-16f9-4191-9bd4-ca6bf7efd86d" released by "delete_volume" :: held 0.671s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Created reservations ['8932b0e6-7f3c-4123-973f-a3e19358f687', '31a5f1aa-94a0-4d43-9b86-52ea561e319e', '16725a1e-006f-485f-bff8-1517240dc7fc', '13d5970d-7b79-4b22-b50d-617cccb4b324'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-01380f5d-e7ae-4b36-8627-11dc1036d919-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Lock "cinder-01380f5d-e7ae-4b36-8627-11dc1036d919-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-0b540815-1eff-4c72-b92a-09104d7dcc5b" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-0b540815-1eff-4c72-b92a-09104d7dcc5b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-01380f5d-e7ae-4b36-8627-11dc1036d919" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-01380f5d-e7ae-4b36-8627-11dc1036d919" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Deleting offline snapshot 01380f5d-e7ae-4b36-8627-11dc1036d919 of volume 0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] snapshot_file for this snap is: volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3735bc-ff55-4d71-a514-65a7c9004506]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:08 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:08 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f" returned: 0 in 0.346s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:08 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f is being set with open permissions: ugo+rw
Sep 11 06:34:08 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:08 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f
Sep 11 06:34:08 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:08 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919
Sep 11 06:34:08 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:08 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Deleted volume successfully.
Sep 11 06:34:08 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-045bb6be-79ee-4a1d-98db-6d0a3f283b13 tempest-SnapshotDependencyTests-825982225 None] Lock "cinder-b80820c6-16f9-4191-9bd4-ca6bf7efd86d-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:08 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.info
Sep 11 06:34:08 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:08 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919" returned: 0 in 0.427s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b540815-1eff-4c72-b92a-09104d7dcc5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d4209-a167-472b-a057-f2cce6a910d6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:08 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b
Sep 11 06:34:08 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:08 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.info" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:08 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.info is being set with open permissions: ugo+rw
Sep 11 06:34:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:08 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.info
Sep 11 06:34:08 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:09 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b" returned: 0 in 0.415s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:09 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919
Sep 11 06:34:09 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:09 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.info" returned: 0 in 0.278s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:09 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e6d34390-ff6c-40d6-96d8-81e388d1903d tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:34:09 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919" returned: 0 in 0.378s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:09 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919
Sep 11 06:34:09 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-5b5e0d98-e4a4-4f3b-97ed-00116271059f-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Lock "cinder-5b5e0d98-e4a4-4f3b-97ed-00116271059f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-5b5e0d98-e4a4-4f3b-97ed-00116271059f" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-5b5e0d98-e4a4-4f3b-97ed-00116271059f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot 5b5e0d98-e4a4-4f3b-97ed-00116271059f of volume e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a30e4b4-8a6f-4890-ab22-0742d44ce3ef]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:09 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b.01380f5d-e7ae-4b36-8627-11dc1036d919" returned: 0 in 0.275s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-01380f5d-e7ae-4b36-8627-11dc1036d919" released by "_delete_snapshot" :: held 1.600s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-0b540815-1eff-4c72-b92a-09104d7dcc5b" released by "delete_snapshot" :: held 1.635s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:09 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f
Sep 11 06:34:09 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Created reservations ['18744983-2ec3-43c0-9812-e39c94620066', '53c8ad5b-d74f-475e-b2fe-d0486e803a39', 'caefcf68-28ee-4f3b-af0c-5d4bd4629c36', '9bad286b-5354-4040-af78-c2f12c6426e2'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:09 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Delete snapshot completed successfully.
Sep 11 06:34:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-684788ef-8ddb-446c-9c37-b8665e4c0dfe tempest-ProjectReaderTests-1260733943 None] Lock "cinder-01380f5d-e7ae-4b36-8627-11dc1036d919-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:10 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f" returned: 0 in 0.395s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[66036110-d150-46d5-a235-a19c70fd1aa2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:10 devstack sudo[106646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5
Sep 11 06:34:10 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-0b540815-1eff-4c72-b92a-09104d7dcc5b-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Lock "cinder-0b540815-1eff-4c72-b92a-09104d7dcc5b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-0b540815-1eff-4c72-b92a-09104d7dcc5b" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-0b540815-1eff-4c72-b92a-09104d7dcc5b" acquired by "delete_volume" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[920ddedb-86d1-4119-9482-ef99d128896e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:10 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b
Sep 11 06:34:10 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:10 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" returned: 0 in 0.426s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:10 devstack sudo[106653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f
Sep 11 06:34:10 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:10 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b" returned: 0 in 0.385s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:10 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b
Sep 11 06:34:10 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:10 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f" returned: 0 in 0.375s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:11 devstack sudo[106663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f
Sep 11 06:34:11 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:11 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-0b540815-1eff-4c72-b92a-09104d7dcc5b" returned: 0 in 0.275s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-0b540815-1eff-4c72-b92a-09104d7dcc5b" released by "delete_volume" :: held 0.737s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Created reservations ['56bf3c90-7e00-4d06-bf6e-989adcfcdd10', 'ad1f282f-4dce-4b56-9b60-0bc7ad076c2f', '249fb345-ddf2-48c2-91ef-fd5bff3ff6b0', '41b70a82-a8ea-4e26-8ce3-b0c2c9ac6f59'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:11 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5.5b5e0d98-e4a4-4f3b-97ed-00116271059f" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-5b5e0d98-e4a4-4f3b-97ed-00116271059f" released by "_delete_snapshot" :: held 1.622s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" released by "delete_snapshot" :: held 1.650s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:11 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:11 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Created reservations ['f01ef79a-f8ff-4bc5-b32d-46e062a5a526', '87206aad-e03d-40c7-9e66-23d095b9ac53', '0cbc6eb0-fe25-491d-8151-de7d6bec82b2', 'badfb8fa-35de-442d-b96a-8066d5f5632e'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-e8615972-0e32-4355-a2e0-93385e3a280d tempest-ProjectMemberTests-716560810 None] Lock "cinder-5b5e0d98-e4a4-4f3b-97ed-00116271059f-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:11 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Deleted volume successfully.
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b3090853-fa9c-418a-94fa-cf952a0e4b7a tempest-ProjectReaderTests-1260733943 None] Lock "cinder-0b540815-1eff-4c72-b92a-09104d7dcc5b-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-e4073f8e-a31d-4bf8-b30a-f28cae055fe5-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Lock "cinder-e4073f8e-a31d-4bf8-b30a-f28cae055fe5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[734af59a-9d51-4b97-9099-80e03a52b2fa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:12 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5
Sep 11 06:34:12 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (c8f73345-1087-49b5-8489-d5e157b4f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2149fc-cbdb-4615-84b7-8243d4aadde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2149fc-cbdb-4615-84b7-8243d4aadde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930229320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9a13fa-3be3-4088-91d3-99e6e04848b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:12Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e4c7d3-96ec-4ad7-8af2-6b776f3c6e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e4c7d3-96ec-4ad7-8af2-6b776f3c6e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b6ccc1-1dbf-465c-b545-d439309d7576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b6ccc1-1dbf-465c-b545-d439309d7576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9a13fa-3be3-4088-91d3-99e6e04848b6', 'volume_name': 'volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5459c8b-6ed0-4dd4-b314-ee39b6b6263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5459c8b-6ed0-4dd4-b314-ee39b6b6263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2656134-87cb-43f7-b5a7-3251dc3e091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:12 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Volume ed9a13fa-3be3-4088-91d3-99e6e04848b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6', 'volume_size': 1}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930229320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9a13fa-3be3-4088-91d3-99e6e04848b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:12Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Creating volume ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:12 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:12 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 1073741824
Sep 11 06:34:12 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:12 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" returned: 0 in 0.460s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:12 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5
Sep 11 06:34:12 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:12 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" returned: 0 in 0.298s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e4073f8e-a31d-4bf8-b30a-f28cae055fe5" released by "delete_volume" :: held 0.821s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:12 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 1073741824" returned: 0 in 0.544s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:12 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6
Sep 11 06:34:12 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Created reservations ['9741e945-7ce5-4755-ba0a-98e1a65b2cf9', 'e9f91006-24b9-44ea-b096-b48180cd03f7', '8c4bb38c-e80b-427b-8e91-38f91f3879a1', '93271b98-d6b1-4594-9b04-29991cc132fa'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:12 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:12 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:13 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.340s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:13 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6" returned: 0 in 0.491s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2656134-87cb-43f7-b5a7-3251dc3e091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045e0ce3-ca0b-4f23-899d-2359aefcbf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Volume volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 (ed9a13fa-3be3-4088-91d3-99e6e04848b6): created successfully
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045e0ce3-ca0b-4f23-899d-2359aefcbf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (c8f73345-1087-49b5-8489-d5e157b4f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2c8dbd8b-cfda-41c2-8212-28daadcca261 tempest-ProjectMemberTests-716560810 None] Lock "cinder-e4073f8e-a31d-4bf8-b30a-f28cae055fe5-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:13 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0122bd48-dee3-4b27-9618-a548d77e3f0b tempest-ProjectReaderTests-1260733943 None] Created volume successfully.
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (f3f692cc-d5b1-4c97-b871-aaf11586be1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05de0f35-1dda-4181-8bce-0641e0e938a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05de0f35-1dda-4181-8bce-0641e0e938a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51755689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bb2611-a143-44c3-9160-87e74f7878f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:14Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facefe1d-4be5-4904-b300-30866e8dc615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facefe1d-4be5-4904-b300-30866e8dc615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74faeb8-29ba-4823-8048-12b70cad96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74faeb8-29ba-4823-8048-12b70cad96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1bb2611-a143-44c3-9160-87e74f7878f2', 'volume_name': 'volume-e1bb2611-a143-44c3-9160-87e74f7878f2', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d441f6-ad9d-469f-9685-8aa15597ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d441f6-ad9d-469f-9685-8aa15597ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487c9c1-2ccf-4742-a2b4-03339223e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:13 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Volume e1bb2611-a143-44c3-9160-87e74f7878f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1bb2611-a143-44c3-9160-87e74f7878f2', 'volume_size': 1}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51755689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bb2611-a143-44c3-9160-87e74f7878f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:14Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Creating volume e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:13 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:13 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:13 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 1073741824
Sep 11 06:34:13 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:14 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 1073741824" returned: 0 in 0.545s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:14 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2
Sep 11 06:34:14 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:14 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2" returned: 0 in 0.245s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.255s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Creating offline snapshot e2cf029a-978e-4842-979a-c89ebcf95b1f of volume ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487c9c1-2ccf-4742-a2b4-03339223e170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bb2611-a143-44c3-9160-87e74f7878f2', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b52654-ae25-422b-b597-6d9c4bca1c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[237e711e-51a5-4899-8be2-2bddf3e11d46]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:14 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Volume volume-e1bb2611-a143-44c3-9160-87e74f7878f2 (e1bb2611-a143-44c3-9160-87e74f7878f2): created successfully
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b52654-ae25-422b-b597-6d9c4bca1c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:14 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (f3f692cc-d5b1-4c97-b871-aaf11586be1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:14 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-48c2d68a-8187-4925-a077-eae00a222f1a tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:34:14 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6
Sep 11 06:34:14 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:15 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6" returned: 0 in 0.377s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:15 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f 1G
Sep 11 06:34:15 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:15 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f 1G" returned: 0 in 0.439s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:15 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f
Sep 11 06:34:15 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:15 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f" returned: 0 in 0.308s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:15 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f is being set with open permissions: ugo+rw
Sep 11 06:34:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:15 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f
Sep 11 06:34:15 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:15 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:16 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f" returned: 0 in 0.288s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:16 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.info
Sep 11 06:34:16 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:16 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.info" returned: 0 in 0.245s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:16 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.info is being set with open permissions: ugo+rw
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:16 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.info
Sep 11 06:34:16 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:16 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.info" returned: 0 in 0.239s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Creating offline snapshot 1e0d851a-f93c-4095-8ebc-5d0620aa378f of volume e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb3f63-a62a-45a8-b751-c43532d61deb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:16 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:16 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2e526100-4e3b-4ebc-b7ff-f7e2f79a89ed tempest-ProjectReaderTests-1260733943 None] Create snapshot completed successfully
Sep 11 06:34:16 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2
Sep 11 06:34:16 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:17 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2" returned: 0 in 0.381s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:17 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f 1G
Sep 11 06:34:17 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-e2cf029a-978e-4842-979a-c89ebcf95b1f-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-e2cf029a-978e-4842-979a-c89ebcf95b1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-ed9a13fa-3be3-4088-91d3-99e6e04848b6" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:17 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f 1G" returned: 0 in 0.535s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bb2611-a143-44c3-9160-87e74f7878f2 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-ed9a13fa-3be3-4088-91d3-99e6e04848b6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-e2cf029a-978e-4842-979a-c89ebcf95b1f" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:17 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bb2611-a143-44c3-9160-87e74f7878f2 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f
Sep 11 06:34:17 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-e2cf029a-978e-4842-979a-c89ebcf95b1f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Deleting offline snapshot e2cf029a-978e-4842-979a-c89ebcf95b1f of volume ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] snapshot_file for this snap is: volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3973744-df16-4002-94b0-e1e7150a08ff]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:17 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f
Sep 11 06:34:17 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:17 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1bb2611-a143-44c3-9160-87e74f7878f2 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f" returned: 0 in 0.334s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:17 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f is being set with open permissions: ugo+rw
Sep 11 06:34:17 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:17 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f
Sep 11 06:34:17 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:18 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f" returned: 0 in 0.446s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2eec1b-6cb3-4e4a-bce7-f71a3f41bf73]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:18 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:18 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6
Sep 11 06:34:18 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:18 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.info
Sep 11 06:34:18 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:18 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6" returned: 0 in 0.384s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:18 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.info" returned: 0 in 0.287s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:18 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.info is being set with open permissions: ugo+rw
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:18 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f
Sep 11 06:34:18 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:18 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.info
Sep 11 06:34:18 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:18 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.info" returned: 0 in 0.264s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:18 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b80c1395-95b2-40b1-a197-2ba69389e5c2 tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:34:18 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f" returned: 0 in 0.388s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:18 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:18 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f
Sep 11 06:34:18 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-1e0d851a-f93c-4095-8ebc-5d0620aa378f-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Lock "cinder-1e0d851a-f93c-4095-8ebc-5d0620aa378f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-e1bb2611-a143-44c3-9160-87e74f7878f2" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:19 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6.e2cf029a-978e-4842-979a-c89ebcf95b1f" returned: 0 in 0.297s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e1bb2611-a143-44c3-9160-87e74f7878f2" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-1e0d851a-f93c-4095-8ebc-5d0620aa378f" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-e2cf029a-978e-4842-979a-c89ebcf95b1f" released by "_delete_snapshot" :: held 1.637s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-1e0d851a-f93c-4095-8ebc-5d0620aa378f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot 1e0d851a-f93c-4095-8ebc-5d0620aa378f of volume e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-ed9a13fa-3be3-4088-91d3-99e6e04848b6" released by "delete_snapshot" :: held 1.697s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5dad18-deb5-492b-b69a-8abe2d6932fd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Created reservations ['1c7c74e8-cc0a-468a-bf12-868c6f0cd86c', '285ebd4a-103f-4cf0-b445-9bdf69009431', '386f815a-1e35-4c26-a25a-a2c041d032fa', 'bddf8cfc-fa20-4e63-ae3c-ed4e90e6f990'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:19 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f
Sep 11 06:34:19 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:19 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Delete snapshot completed successfully.
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-865ed26a-c15b-4bbb-9c19-10c050926cd5 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-e2cf029a-978e-4842-979a-c89ebcf95b1f-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:19 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f" returned: 0 in 0.388s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bb2611-a143-44c3-9160-87e74f7878f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-ed9a13fa-3be3-4088-91d3-99e6e04848b6-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad2588a-ba08-49c3-a5e3-052b8a747c51]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Lock "cinder-ed9a13fa-3be3-4088-91d3-99e6e04848b6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-ed9a13fa-3be3-4088-91d3-99e6e04848b6" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-ed9a13fa-3be3-4088-91d3-99e6e04848b6" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2149804-3ab0-40c1-87a0-511f81e74010]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:19 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:19 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2
Sep 11 06:34:19 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:19 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6
Sep 11 06:34:19 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:20 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2" returned: 0 in 0.429s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:20 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f
Sep 11 06:34:20 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:20 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6" returned: 0 in 0.413s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:20 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6
Sep 11 06:34:20 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:20 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f" returned: 0 in 0.333s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:20 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f
Sep 11 06:34:20 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:20 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-ed9a13fa-3be3-4088-91d3-99e6e04848b6" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-ed9a13fa-3be3-4088-91d3-99e6e04848b6" released by "delete_volume" :: held 0.742s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Created reservations ['c67609ef-b4b5-40a7-999e-51904ac5e4f8', '1297e3a0-721c-4f4a-8dfb-cf8f6cf08e9d', 'ac8c22c4-e8ff-4ce1-ad88-8b7ac1319d0d', 'c939a96e-56bd-4bb2-848b-c1364a5ec999'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:20 devstack sudo[106799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:20 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:20 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2.1e0d851a-f93c-4095-8ebc-5d0620aa378f" returned: 0 in 0.245s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-1e0d851a-f93c-4095-8ebc-5d0620aa378f" released by "_delete_snapshot" :: held 1.532s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e1bb2611-a143-44c3-9160-87e74f7878f2" released by "delete_snapshot" :: held 1.566s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Created reservations ['4d8cf32a-be0b-4962-b6b4-d8ba4849104c', 'eebf69e9-7611-4c0c-ba14-03c83e343b40', 'da40d031-4e69-4ea1-89d4-45e1df2b8478', 'e788284e-0e7d-4848-9a31-35fca8ac2d49'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-8878c662-745d-4b46-b3b7-c089e0a6caac tempest-ProjectMemberTests-716560810 None] Lock "cinder-1e0d851a-f93c-4095-8ebc-5d0620aa378f-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:20 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.272s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:20 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Deleted volume successfully.
Sep 11 06:34:20 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-548c6d8e-d451-4891-a4ac-f057149fd5dd tempest-ProjectReaderTests-1260733943 None] Lock "cinder-ed9a13fa-3be3-4088-91d3-99e6e04848b6-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-e1bb2611-a143-44c3-9160-87e74f7878f2-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (b12d0096-0ea4-492c-bdc8-8f518e5af0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad76f0d-e003-4897-8fd0-54b7a4ab7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Lock "cinder-e1bb2611-a143-44c3-9160-87e74f7878f2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad76f0d-e003-4897-8fd0-54b7a4ab7423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058587581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4689602-91e6-45ea-ae7f-ad3e939c305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:21Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327e615-c8b6-4bbb-991a-f3e89879d0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327e615-c8b6-4bbb-991a-f3e89879d0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c225e2-7a20-4e72-b284-71ba85139461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c225e2-7a20-4e72-b284-71ba85139461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4689602-91e6-45ea-ae7f-ad3e939c305c', 'volume_name': 'volume-f4689602-91e6-45ea-ae7f-ad3e939c305c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4df101e-fdfc-4332-80a3-1b5623a1145d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4df101e-fdfc-4332-80a3-1b5623a1145d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eeb1074-2cd3-421c-95a3-cdc25c652a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:21 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Volume f4689602-91e6-45ea-ae7f-ad3e939c305c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4689602-91e6-45ea-ae7f-ad3e939c305c', 'volume_size': 1}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058587581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4689602-91e6-45ea-ae7f-ad3e939c305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1df6871104b92b3ce82b406db8952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:21Z,use_quota=True,user_id='e2b33ca187a544e5a8593a7b1af98c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Creating volume f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:21 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:21 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c 1073741824
Sep 11 06:34:21 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-e1bb2611-a143-44c3-9160-87e74f7878f2" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e1bb2611-a143-44c3-9160-87e74f7878f2" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0e5100-fbcb-4952-a701-b6eceea8689b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:21 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2
Sep 11 06:34:21 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:21 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c 1073741824" returned: 0 in 0.403s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:21 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2" returned: 0 in 0.374s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:21 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:21 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c
Sep 11 06:34:21 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:21 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2
Sep 11 06:34:21 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:22 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c" returned: 0 in 0.242s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:22 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eeb1074-2cd3-421c-95a3-cdc25c652a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4689602-91e6-45ea-ae7f-ad3e939c305c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac07bf9-8093-46c8-a6b5-2b4e70cfbc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1bb2611-a143-44c3-9160-87e74f7878f2" returned: 0 in 0.252s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e1bb2611-a143-44c3-9160-87e74f7878f2" released by "delete_volume" :: held 0.690s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:22 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Volume volume-f4689602-91e6-45ea-ae7f-ad3e939c305c (f4689602-91e6-45ea-ae7f-ad3e939c305c): created successfully
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac07bf9-8093-46c8-a6b5-2b4e70cfbc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Flow 'volume_create_manager' (b12d0096-0ea4-492c-bdc8-8f518e5af0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:22 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-acbafeb3-45ec-4b4e-bd14-8f4929065fd7 tempest-ProjectReaderTests-1260733943 None] Created volume successfully.
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Created reservations ['545dac1e-5687-4602-95d0-198911f3ecf5', '6d7a2e00-3583-43a7-8e2a-1676e44e4bf9', 'a9d31329-eb0d-4d3a-b98e-13cee5159550', '69edd440-2d39-43bd-94de-b9456215c991'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:22 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:22 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Creating offline snapshot f1b7cd7c-0617-47dd-8203-1623ab667bfb of volume f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca7a81-3948-4362-95f2-8526ae1e9c00]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:22 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.287s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:22 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:34:22 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-bf7d4206-a7b3-47c8-832a-4f4203bc7ddc tempest-ProjectMemberTests-716560810 None] Lock "cinder-e1bb2611-a143-44c3-9160-87e74f7878f2-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:22 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c
Sep 11 06:34:22 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:22 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c" returned: 0 in 0.410s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:23 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb 1G
Sep 11 06:34:23 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (668ec019-45d9-4ad7-9462-3ab2646a94ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac5b7a2-eeb6-4ae6-8de5-7ac029a9d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac5b7a2-eeb6-4ae6-8de5-7ac029a9d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198056697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3200ec1-0cac-478d-a579-3d51c69a603c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:23Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253f2e6e-feda-4fac-aa53-d8c4e5748459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253f2e6e-feda-4fac-aa53-d8c4e5748459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178fed43-3a34-4e0b-a1ad-52e9a297a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178fed43-3a34-4e0b-a1ad-52e9a297a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3200ec1-0cac-478d-a579-3d51c69a603c', 'volume_name': 'volume-f3200ec1-0cac-478d-a579-3d51c69a603c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9953b7-a612-46f4-be1d-d7a93d68b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9953b7-a612-46f4-be1d-d7a93d68b499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5c5f1e-fb45-485a-a672-6f18c7078752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:23 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Volume f3200ec1-0cac-478d-a579-3d51c69a603c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3200ec1-0cac-478d-a579-3d51c69a603c', 'volume_size': 1}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:23 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb 1G" returned: 0 in 0.393s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4689602-91e6-45ea-ae7f-ad3e939c305c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:23 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4689602-91e6-45ea-ae7f-ad3e939c305c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb
Sep 11 06:34:23 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:23 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4689602-91e6-45ea-ae7f-ad3e939c305c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:23 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb is being set with open permissions: ugo+rw
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:23 devstack sudo[106838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb
Sep 11 06:34:23 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:23 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb" returned: 0 in 0.242s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:23 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:23 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.info
Sep 11 06:34:23 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:24 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.info" returned: 0 in 0.244s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:24 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.info is being set with open permissions: ugo+rw
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:24 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.info
Sep 11 06:34:24 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:24 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.info" returned: 0 in 0.237s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198056697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3200ec1-0cac-478d-a579-3d51c69a603c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:23Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Creating volume f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:24 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:24 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c 1073741824
Sep 11 06:34:24 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:24 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-cb8546f1-ecd4-41cb-897c-738b81ae5b4b tempest-ProjectReaderTests-1260733943 None] Create snapshot completed successfully
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-f1b7cd7c-0617-47dd-8203-1623ab667bfb-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Lock "cinder-f1b7cd7c-0617-47dd-8203-1623ab667bfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-f4689602-91e6-45ea-ae7f-ad3e939c305c" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-f4689602-91e6-45ea-ae7f-ad3e939c305c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-f1b7cd7c-0617-47dd-8203-1623ab667bfb" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-f1b7cd7c-0617-47dd-8203-1623ab667bfb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Deleting offline snapshot f1b7cd7c-0617-47dd-8203-1623ab667bfb of volume f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] snapshot_file for this snap is: volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3babc76c-5176-4dc5-abb4-141bb3feac26]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:24 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb
Sep 11 06:34:24 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:24 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c 1073741824" returned: 0 in 0.458s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:24 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:24 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c
Sep 11 06:34:24 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:25 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb" returned: 0 in 0.372s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4689602-91e6-45ea-ae7f-ad3e939c305c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f72b4-7d5e-4f87-8f2a-d00696240010]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:25 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c" returned: 0 in 0.264s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5c5f1e-fb45-485a-a672-6f18c7078752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3200ec1-0cac-478d-a579-3d51c69a603c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5610e3f-62b4-4ae0-91ac-ce5cac12057f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:25 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Volume volume-f3200ec1-0cac-478d-a579-3d51c69a603c (f3200ec1-0cac-478d-a579-3d51c69a603c): created successfully
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5610e3f-62b4-4ae0-91ac-ce5cac12057f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (668ec019-45d9-4ad7-9462-3ab2646a94ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:25 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-0e3f63a0-c09e-417b-8c62-5de19138d9e3 tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:34:25 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c
Sep 11 06:34:25 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:25 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c" returned: 0 in 0.356s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:25 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb
Sep 11 06:34:25 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:25 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb" returned: 0 in 0.326s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:25 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:25 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb
Sep 11 06:34:25 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:26 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c.f1b7cd7c-0617-47dd-8203-1623ab667bfb" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-f1b7cd7c-0617-47dd-8203-1623ab667bfb" released by "_delete_snapshot" :: held 1.434s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-f4689602-91e6-45ea-ae7f-ad3e939c305c" released by "delete_snapshot" :: held 1.468s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=181,cinder:INSERT=66,cinder:UPDATE=234,cinder:DELETE=21 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=190,cinder:UPDATE=235,cinder:INSERT=63,cinder:DELETE=18 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Created reservations ['87af5783-8141-4637-8bdc-47b66ebdd8fb', '3765abc4-a3b8-4b5c-ad22-58a80c5a22a6', '1f6cd7cb-1ef2-4288-abbe-3f585e9836e8', 'cc0a3526-d3f7-4cac-a888-816a76a5f300'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:26 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Delete snapshot completed successfully.
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1eabdd1e-cde4-44f3-8277-fd09eb4477cb tempest-ProjectReaderTests-1260733943 None] Lock "cinder-f1b7cd7c-0617-47dd-8203-1623ab667bfb-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Creating offline snapshot e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 of volume f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f6cf7-f9a0-443a-b463-645c3ff67304]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:26 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c
Sep 11 06:34:26 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:26 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c" returned: 0 in 0.344s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:26 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 1G
Sep 11 06:34:26 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-f4689602-91e6-45ea-ae7f-ad3e939c305c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-f4689602-91e6-45ea-ae7f-ad3e939c305c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "cinder-quobyte-f4689602-91e6-45ea-ae7f-ad3e939c305c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-f4689602-91e6-45ea-ae7f-ad3e939c305c" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e909b69-7648-4b38-b09b-0dba0681f883]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:26 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:27 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c
Sep 11 06:34:27 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:27 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 1G" returned: 0 in 0.433s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3200ec1-0cac-478d-a579-3d51c69a603c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:27 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3200ec1-0cac-478d-a579-3d51c69a603c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91
Sep 11 06:34:27 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:27 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c" returned: 0 in 0.384s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:27 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c
Sep 11 06:34:27 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:27 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3200ec1-0cac-478d-a579-3d51c69a603c -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" returned: 0 in 0.304s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:27 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 is being set with open permissions: ugo+rw
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:27 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91
Sep 11 06:34:27 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:27 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f4689602-91e6-45ea-ae7f-ad3e939c305c" returned: 0 in 0.254s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-quobyte-f4689602-91e6-45ea-ae7f-ad3e939c305c" released by "delete_volume" :: held 0.694s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Created reservations ['e539542b-3006-4874-a646-0f73fa4a0a96', '7d1c3ace-49bd-4307-b089-590580f822d7', '20abd892-50e4-40e4-8ba4-361425790a84', 'f672634e-bf1d-4180-b5f8-32b3d6ffab35'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:27 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:27 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:27 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" returned: 0 in 0.251s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:27 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.info
Sep 11 06:34:27 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:27 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.269s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:27 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:27 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Deleted volume successfully.
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-c4807fef-ee5f-4449-961e-a57934908d78 tempest-ProjectReaderTests-1260733943 None] Lock "cinder-f4689602-91e6-45ea-ae7f-ad3e939c305c-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:28 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.info" returned: 0 in 0.289s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:28 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.info is being set with open permissions: ugo+rw
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:28 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.info
Sep 11 06:34:28 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:28 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.info" returned: 0 in 0.273s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:28 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-278742f6-6476-4a2a-ba05-52f91c671676 tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Lock "cinder-e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-f3200ec1-0cac-478d-a579-3d51c69a603c" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-f3200ec1-0cac-478d-a579-3d51c69a603c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 of volume f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba77880-13ee-4316-a96f-443c95fd00ba]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:28 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91
Sep 11 06:34:28 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:28 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" returned: 0 in 0.384s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:28 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3200ec1-0cac-478d-a579-3d51c69a603c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:29 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917f82f-f0c1-4b2a-8bb9-6d89eef2c278]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:29 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c
Sep 11 06:34:29 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:29 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c" returned: 0 in 0.366s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:29 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91
Sep 11 06:34:29 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:29 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" returned: 0 in 0.379s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:29 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:29 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91
Sep 11 06:34:29 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:30 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c.e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" returned: 0 in 0.263s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91" released by "_delete_snapshot" :: held 1.485s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-f3200ec1-0cac-478d-a579-3d51c69a603c" released by "delete_snapshot" :: held 1.507s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Created reservations ['acac2d90-ef7f-4a4e-af0e-6e5b174bdddb', 'cbd74f51-7c4f-49a5-af59-1da60e346861', 'f5126092-8055-4c49-82b9-0db3b868ff06', 'a440d3d2-5efe-4641-a2a0-a045acb44560'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:30 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-a01edb88-41dd-4255-8f58-d9a6d21ce93c tempest-ProjectMemberTests-716560810 None] Lock "cinder-e3bd3d6a-37f0-4d1a-ad16-a75e6e443b91-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-f3200ec1-0cac-478d-a579-3d51c69a603c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Lock "cinder-f3200ec1-0cac-478d-a579-3d51c69a603c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-f3200ec1-0cac-478d-a579-3d51c69a603c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-f3200ec1-0cac-478d-a579-3d51c69a603c" acquired by "delete_volume" :: waited 0.018s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6562af-89f7-4eb1-9092-b29d833be551]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:30 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:30 devstack sudo[106932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c
Sep 11 06:34:30 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:31 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:31 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:31 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c" returned: 0 in 0.388s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:31 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c
Sep 11 06:34:31 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:31 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.259s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 06:34:31 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-f3200ec1-0cac-478d-a579-3d51c69a603c" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-f3200ec1-0cac-478d-a579-3d51c69a603c" released by "delete_volume" :: held 0.703s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Created reservations ['0c103917-3021-47c0-8c1d-1906f71614e1', '3ff20882-434c-4d5a-8cde-ab71edcbb043', '055f06d7-3cfe-4927-8613-64ede453238a', '885e4ed8-c9ea-4522-bfe2-1022275e1e39'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:31 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:31 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:31 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.261s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:31 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:34:31 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-1587c30a-ba71-4ed3-be0c-2c5a035cffea tempest-ProjectMemberTests-716560810 None] Lock "cinder-f3200ec1-0cac-478d-a579-3d51c69a603c-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (47bd215f-1400-4a5f-ac9e-6039b670da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8532bc10-a35b-4182-9548-27ad2cd00a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8532bc10-a35b-4182-9548-27ad2cd00a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508110889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ea567f-3475-46ab-8d78-e5f4f5963098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:32Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d2c2d-ec34-4d4f-8d49-990303446c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d2c2d-ec34-4d4f-8d49-990303446c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5a910d-c575-4947-bd7e-7ddc40d9d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5a910d-c575-4947-bd7e-7ddc40d9d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ea567f-3475-46ab-8d78-e5f4f5963098', 'volume_name': 'volume-59ea567f-3475-46ab-8d78-e5f4f5963098', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a936098c-5d5f-461f-85d3-47c84f524546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a936098c-5d5f-461f-85d3-47c84f524546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d024744-30a7-4e8e-bfc1-6b176281bc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:32 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Volume 59ea567f-3475-46ab-8d78-e5f4f5963098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ea567f-3475-46ab-8d78-e5f4f5963098', 'volume_size': 1}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1508110889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ea567f-3475-46ab-8d78-e5f4f5963098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c22fcf11b7d4bf4a4074727019f5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:32Z,use_quota=True,user_id='7c84d2e6106e4a92a72ee43a6beee005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Creating volume 59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:32 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:32 devstack sudo[106948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 1073741824
Sep 11 06:34:32 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:32 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:32 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 1073741824" returned: 0 in 0.447s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:33 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098
Sep 11 06:34:33 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:33 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098" returned: 0 in 0.276s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d024744-30a7-4e8e-bfc1-6b176281bc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ea567f-3475-46ab-8d78-e5f4f5963098', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdcae0c-409e-4f90-ba9e-21188b9e9862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:33 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Volume volume-59ea567f-3475-46ab-8d78-e5f4f5963098 (59ea567f-3475-46ab-8d78-e5f4f5963098): created successfully
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdcae0c-409e-4f90-ba9e-21188b9e9862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:33 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Flow 'volume_create_manager' (47bd215f-1400-4a5f-ac9e-6039b670da2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:33 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-e6c2e0f4-edeb-4454-b0e6-58af073c1bf8 tempest-ProjectMemberTests-716560810 None] Created volume successfully.
Sep 11 06:34:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:34 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Creating offline snapshot 50471e44-d003-47fd-8c5b-0c35af2ce053 of volume 59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 06:34:34 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8673797-cec3-4329-9ebb-84c92d7b6e10]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:34 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:34 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098
Sep 11 06:34:34 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:35 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098" returned: 0 in 0.351s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 1G {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:35 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 1G
Sep 11 06:34:35 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:35 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 1G" returned: 0 in 0.379s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ea567f-3475-46ab-8d78-e5f4f5963098 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:35 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ea567f-3475-46ab-8d78-e5f4f5963098 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053
Sep 11 06:34:35 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:35 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ea567f-3475-46ab-8d78-e5f4f5963098 -F qcow2 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053" returned: 0 in 0.297s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:35 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 is being set with open permissions: ugo+rw
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:35 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053
Sep 11 06:34:35 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:35 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053" returned: 0 in 0.260s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:35 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:36 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.info
Sep 11 06:34:36 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:36 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.info" returned: 0 in 0.257s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:36 devstack cinder-volume[88109]: WARNING cinder.volume.drivers.remotefs [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.info is being set with open permissions: ugo+rw
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.info {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:36 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.info
Sep 11 06:34:36 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:36 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.info" returned: 0 in 0.250s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:36 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-7e4e8c40-f84a-4912-9506-50b60bb7d603 tempest-ProjectMemberTests-716560810 None] Create snapshot completed successfully
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-50471e44-d003-47fd-8c5b-0c35af2ce053-delete_snapshot" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Lock "cinder-50471e44-d003-47fd-8c5b-0c35af2ce053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-59ea567f-3475-46ab-8d78-e5f4f5963098" by "delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-59ea567f-3475-46ab-8d78-e5f4f5963098" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-50471e44-d003-47fd-8c5b-0c35af2ce053" by "_delete_snapshot" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-50471e44-d003-47fd-8c5b-0c35af2ce053" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Deleting offline snapshot 50471e44-d003-47fd-8c5b-0c35af2ce053 of volume 59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] snapshot_file for this snap is: volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 {{(pid=88109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f35a36-6866-40e5-b6df-26a82c139757]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:36 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:37 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053
Sep 11 06:34:37 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:37 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053" returned: 0 in 0.348s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ea567f-3475-46ab-8d78-e5f4f5963098(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[48878dad-df2d-4232-9259-9fab30a54b9d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:37 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098
Sep 11 06:34:37 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:37 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098" returned: 0 in 0.351s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:37 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053
Sep 11 06:34:37 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:37 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053" returned: 0 in 0.322s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:37 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:38 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053
Sep 11 06:34:38 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:38 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:38 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098.50471e44-d003-47fd-8c5b-0c35af2ce053" returned: 0 in 0.243s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-50471e44-d003-47fd-8c5b-0c35af2ce053" released by "_delete_snapshot" :: held 1.348s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-59ea567f-3475-46ab-8d78-e5f4f5963098" released by "delete_snapshot" :: held 1.368s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:38 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Created reservations ['caa581ce-bab2-4517-8978-64fd54cf7963', '24a27122-391a-4114-9643-f7fd680388e6', 'a6a9c14b-60ba-4032-9405-3f9df94c418c', '4a67d93b-2b30-4880-a1d6-85f6554af693'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:38 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Delete snapshot completed successfully.
Sep 11 06:34:38 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-d8ad5ac5-ffdc-4203-a53b-eb49b07ce47f tempest-ProjectMemberTests-716560810 None] Lock "cinder-50471e44-d003-47fd-8c5b-0c35af2ce053-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-59ea567f-3475-46ab-8d78-e5f4f5963098-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Lock "cinder-59ea567f-3475-46ab-8d78-e5f4f5963098-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Acquiring lock "cinder-quobyte-59ea567f-3475-46ab-8d78-e5f4f5963098" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-59ea567f-3475-46ab-8d78-e5f4f5963098" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d5156-8e3f-4171-b447-3f7bb1f9fe99]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:39 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098
Sep 11 06:34:39 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:39 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098" returned: 0 in 0.364s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:39 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098
Sep 11 06:34:39 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:39 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-59ea567f-3475-46ab-8d78-e5f4f5963098" returned: 0 in 0.236s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Lock "cinder-quobyte-59ea567f-3475-46ab-8d78-e5f4f5963098" released by "delete_volume" :: held 0.653s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Created reservations ['d817e045-7c16-4581-8427-3d1b9f7ab19a', '36a156fc-c03b-4508-b899-214391f67e7e', '51510257-a9da-45f3-9ae4-673ccd38eecb', '887ae98b-fd5a-4409-9b0c-0b7ee75a1023'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:39 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:39 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:39 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:40 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:40 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.235s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:40 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:40 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Deleted volume successfully.
Sep 11 06:34:40 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-b573e747-967a-4cf2-b4fd-8276266d582e tempest-ProjectMemberTests-716560810 None] Lock "cinder-59ea567f-3475-46ab-8d78-e5f4f5963098-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:49 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=40,cinder:INSERT=21,cinder:UPDATE=46,cinder:DELETE=4 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=47,cinder:SELECT=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Flow 'volume_create_manager' (99f77add-1eca-45fb-8e13-411f2d6e231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ff3718-8635-49da-9a93-f74d6b8814b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ff3718-8635-49da-9a93-f74d6b8814b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580482383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192c95a0-cd78-4349-87fe-085f51124fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cd96252eca4db2be4f211e52f8c0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:50Z,use_quota=True,user_id='7a6e2cf9678940d59ad84d227dadcdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcb64d6-d6be-4905-91cd-f20156c702ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcb64d6-d6be-4905-91cd-f20156c702ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ef5ab6-859a-4a5f-b781-75f52b9344b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ef5ab6-859a-4a5f-b781-75f52b9344b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192c95a0-cd78-4349-87fe-085f51124fbe', 'volume_name': 'volume-192c95a0-cd78-4349-87fe-085f51124fbe', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08449f32-eec7-4585-84ec-08055174d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08449f32-eec7-4585-84ec-08055174d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2685273d-0eb3-44b1-8b76-45ad500735c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:50 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Volume 192c95a0-cd78-4349-87fe-085f51124fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192c95a0-cd78-4349-87fe-085f51124fbe', 'volume_size': 1}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580482383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192c95a0-cd78-4349-87fe-085f51124fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cd96252eca4db2be4f211e52f8c0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:50Z,use_quota=True,user_id='7a6e2cf9678940d59ad84d227dadcdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Creating volume 192c95a0-cd78-4349-87fe-085f51124fbe {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:50 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:50 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe 1073741824
Sep 11 06:34:50 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:50 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe 1073741824" returned: 0 in 0.413s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:50 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:51 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe
Sep 11 06:34:51 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:51 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe" returned: 0 in 0.264s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2685273d-0eb3-44b1-8b76-45ad500735c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192c95a0-cd78-4349-87fe-085f51124fbe', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13e220c-7129-465a-9a71-e131251fc466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:51 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Volume volume-192c95a0-cd78-4349-87fe-085f51124fbe (192c95a0-cd78-4349-87fe-085f51124fbe): created successfully
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13e220c-7129-465a-9a71-e131251fc466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Flow 'volume_create_manager' (99f77add-1eca-45fb-8e13-411f2d6e231d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:51 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-94a0af15-4fd7-4a51-81f7-d80f82fe808d tempest-ProjectReaderTests-692010645 None] Created volume successfully.
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Acquiring lock "cinder-192c95a0-cd78-4349-87fe-085f51124fbe-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Lock "cinder-192c95a0-cd78-4349-87fe-085f51124fbe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Acquiring lock "cinder-quobyte-192c95a0-cd78-4349-87fe-085f51124fbe" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Lock "cinder-quobyte-192c95a0-cd78-4349-87fe-085f51124fbe" acquired by "delete_volume" :: waited 0.013s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[174a3f80-bbe6-4b5a-8eee-bd8fdca1bc6b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:51 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:51 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe
Sep 11 06:34:51 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:52 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe" returned: 0 in 0.360s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:52 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe
Sep 11 06:34:52 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:52 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-192c95a0-cd78-4349-87fe-085f51124fbe" returned: 0 in 0.256s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Lock "cinder-quobyte-192c95a0-cd78-4349-87fe-085f51124fbe" released by "delete_volume" :: held 0.655s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Created reservations ['4f97ac90-108c-49a3-8d31-581d6efd1554', 'c697252f-1e91-418c-8bd9-51154ac4fc39', '736dab5c-27b4-4c2e-b84b-317ef3325a4e', '58a2c9ec-bbce-40be-9e9c-67b54d7c668c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:52 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:52 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:52 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.243s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:52 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Deleted volume successfully.
Sep 11 06:34:52 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-26ff5944-a75b-4b0d-9c45-5b00166b9710 tempest-ProjectReaderTests-692010645 None] Lock "cinder-192c95a0-cd78-4349-87fe-085f51124fbe-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Flow 'volume_create_manager' (5dfd881d-6ab3-47c1-9672-9113ec839909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9873eb-a744-4ef6-b161-84df442752df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9873eb-a744-4ef6-b161-84df442752df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291061888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c33bc3e-af3a-4701-8a35-4b66e7578950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cd96252eca4db2be4f211e52f8c0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:53Z,use_quota=True,user_id='7a6e2cf9678940d59ad84d227dadcdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684df74c-f679-403b-a14f-062590eaf37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684df74c-f679-403b-a14f-062590eaf37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fdd819-9603-4def-bc1d-6b8ed3255794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fdd819-9603-4def-bc1d-6b8ed3255794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c33bc3e-af3a-4701-8a35-4b66e7578950', 'volume_name': 'volume-7c33bc3e-af3a-4701-8a35-4b66e7578950', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa2917e-c193-4dab-bf0b-de476dd1c2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa2917e-c193-4dab-bf0b-de476dd1c2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35313da4-1939-4842-b135-c0a360fa00ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:53 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Volume 7c33bc3e-af3a-4701-8a35-4b66e7578950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c33bc3e-af3a-4701-8a35-4b66e7578950', 'volume_size': 1}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291061888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c33bc3e-af3a-4701-8a35-4b66e7578950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cd96252eca4db2be4f211e52f8c0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:34:53Z,use_quota=True,user_id='7a6e2cf9678940d59ad84d227dadcdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Creating volume 7c33bc3e-af3a-4701-8a35-4b66e7578950 {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:34:53 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:53 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950 1073741824
Sep 11 06:34:53 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:53 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950 1073741824" returned: 0 in 0.392s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:53 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950
Sep 11 06:34:53 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:53 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950" returned: 0 in 0.240s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35313da4-1939-4842-b135-c0a360fa00ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c33bc3e-af3a-4701-8a35-4b66e7578950', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:53 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46b6ecf-3d29-4d72-8075-1eadf32dd1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:34:54 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Volume volume-7c33bc3e-af3a-4701-8a35-4b66e7578950 (7c33bc3e-af3a-4701-8a35-4b66e7578950): created successfully
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46b6ecf-3d29-4d72-8075-1eadf32dd1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Flow 'volume_create_manager' (5dfd881d-6ab3-47c1-9672-9113ec839909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:34:54 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-351e10c7-d235-4e9c-96b3-0d422849b74e tempest-ProjectReaderTests-692010645 None] Created volume successfully.
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Acquiring lock "cinder-7c33bc3e-af3a-4701-8a35-4b66e7578950-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Lock "cinder-7c33bc3e-af3a-4701-8a35-4b66e7578950-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Acquiring lock "cinder-quobyte-7c33bc3e-af3a-4701-8a35-4b66e7578950" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Lock "cinder-quobyte-7c33bc3e-af3a-4701-8a35-4b66e7578950" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2527858-de0e-41b8-941e-70fdb99c6441]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:54 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950
Sep 11 06:34:54 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:54 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950" returned: 0 in 0.365s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:54 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950
Sep 11 06:34:54 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:54 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-7c33bc3e-af3a-4701-8a35-4b66e7578950" returned: 0 in 0.258s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:54 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Lock "cinder-quobyte-7c33bc3e-af3a-4701-8a35-4b66e7578950" released by "delete_volume" :: held 0.659s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Created reservations ['2af13571-a489-4c79-b13f-5f495f7b133b', '520de524-aad7-45f4-9d4d-f51707c375ae', '3ab74a58-42fa-4980-aee8-c635b3168201', '73748cc7-c92e-436c-ba9e-04ab358d90a8'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:34:55 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:34:55 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:34:55 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.242s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:34:55 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Deleted volume successfully.
Sep 11 06:34:55 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-42895e47-0f05-4026-92e3-630b865aada8 tempest-ProjectReaderTests-692010645 None] Lock "cinder-7c33bc3e-af3a-4701-8a35-4b66e7578950-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (4db3c6d3-8796-45b8-9a66-9ce92380e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c31a98-bd9c-4679-af11-a74a329bd84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c31a98-bd9c-4679-af11-a74a329bd84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013743821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4030f4bf-3565-4586-a5c5-7a3fefeb886c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:03Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bfe3f1-32c0-4a90-8957-c8777508255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bfe3f1-32c0-4a90-8957-c8777508255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d0cda3-2475-4340-91bd-1d342b95c2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d0cda3-2475-4340-91bd-1d342b95c2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4030f4bf-3565-4586-a5c5-7a3fefeb886c', 'volume_name': 'volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f927753b-237c-4056-a7b3-c608eaa3e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f927753b-237c-4056-a7b3-c608eaa3e493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0329b8fb-6895-493c-b960-ae5309056ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:02 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Volume 4030f4bf-3565-4586-a5c5-7a3fefeb886c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c', 'volume_size': 1}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013743821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4030f4bf-3565-4586-a5c5-7a3fefeb886c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:03Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Creating volume 4030f4bf-3565-4586-a5c5-7a3fefeb886c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:35:02 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:35:02 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:02 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c 1073741824
Sep 11 06:35:02 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:03 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c 1073741824" returned: 0 in 0.427s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:03 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c
Sep 11 06:35:03 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:03 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c" returned: 0 in 0.249s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0329b8fb-6895-493c-b960-ae5309056ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76dcc175-75f6-4484-95f4-f0b0529fb495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:03 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Volume volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c (4030f4bf-3565-4586-a5c5-7a3fefeb886c): created successfully
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76dcc175-75f6-4484-95f4-f0b0529fb495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (4db3c6d3-8796-45b8-9a66-9ce92380e6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:03 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-5b0d532a-b899-49c0-b389-d0a707192c95 tempest-ProjectReaderTests-1505299469 None] Created volume successfully.
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-4030f4bf-3565-4586-a5c5-7a3fefeb886c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Lock "cinder-4030f4bf-3565-4586-a5c5-7a3fefeb886c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-quobyte-4030f4bf-3565-4586-a5c5-7a3fefeb886c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-4030f4bf-3565-4586-a5c5-7a3fefeb886c" acquired by "delete_volume" :: waited 0.021s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44205ac-d08d-4bed-9f18-44da6ad4b8a9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:35:03 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:04 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c
Sep 11 06:35:04 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:04 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c" returned: 0 in 0.348s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:04 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c
Sep 11 06:35:04 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:04 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-4030f4bf-3565-4586-a5c5-7a3fefeb886c" returned: 0 in 0.246s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-4030f4bf-3565-4586-a5c5-7a3fefeb886c" released by "delete_volume" :: held 0.630s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Created reservations ['8acacc2a-743b-40e0-903a-f0e0ba041bd7', 'a79599b3-4561-47a1-aff6-b5e98e5eb9aa', 'f9897297-b17f-4ce8-9371-69452e43ca1e', '4dac9899-df8b-4bce-86ba-a3d1a4ae11bf'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:04 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:35:04 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:04 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.241s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:35:04 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Deleted volume successfully.
Sep 11 06:35:04 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-2cd3d7c0-a4c7-4c07-9182-43941580bc1c tempest-ProjectReaderTests-1505299469 None] Lock "cinder-4030f4bf-3565-4586-a5c5-7a3fefeb886c-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (386c186b-71c2-4876-8c95-a2eb88e6862c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12af143a-6d10-4445-97b9-9d4e76074e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12af143a-6d10-4445-97b9-9d4e76074e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423996999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89abd17a-371c-44e9-9350-19591031b70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:05Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89dbb90b-f9ef-4f70-bd52-ec396bf6fa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89dbb90b-f9ef-4f70-bd52-ec396bf6fa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ba72c9-7239-404b-ba10-b8252bcf75c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ba72c9-7239-404b-ba10-b8252bcf75c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89abd17a-371c-44e9-9350-19591031b70c', 'volume_name': 'volume-89abd17a-371c-44e9-9350-19591031b70c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2712b3-c6d9-412b-a9d8-8d9e4e012868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2712b3-c6d9-412b-a9d8-8d9e4e012868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902dbca7-14a4-44e1-9737-1d1be8435cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:05 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Volume 89abd17a-371c-44e9-9350-19591031b70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89abd17a-371c-44e9-9350-19591031b70c', 'volume_size': 1}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423996999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89abd17a-371c-44e9-9350-19591031b70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:05Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Creating volume 89abd17a-371c-44e9-9350-19591031b70c {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:35:05 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:05 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c 1073741824
Sep 11 06:35:05 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:05 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c 1073741824" returned: 0 in 0.399s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:05 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:05 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c
Sep 11 06:35:05 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:06 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c" returned: 0 in 0.236s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902dbca7-14a4-44e1-9737-1d1be8435cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89abd17a-371c-44e9-9350-19591031b70c', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc08cdb-8d1a-449e-8675-a2e4312ea3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:06 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Volume volume-89abd17a-371c-44e9-9350-19591031b70c (89abd17a-371c-44e9-9350-19591031b70c): created successfully
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc08cdb-8d1a-449e-8675-a2e4312ea3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (386c186b-71c2-4876-8c95-a2eb88e6862c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:06 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f3b8148a-0f59-487b-bbdb-22695340a247 tempest-ProjectReaderTests-1505299469 None] Created volume successfully.
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-89abd17a-371c-44e9-9350-19591031b70c-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-89abd17a-371c-44e9-9350-19591031b70c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-quobyte-89abd17a-371c-44e9-9350-19591031b70c" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-89abd17a-371c-44e9-9350-19591031b70c" acquired by "delete_volume" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59dd683-505a-4448-bfae-ab85afc597a4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:06 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c
Sep 11 06:35:06 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:06 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c" returned: 0 in 0.346s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:06 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:06 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c
Sep 11 06:35:06 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:07 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-89abd17a-371c-44e9-9350-19591031b70c" returned: 0 in 0.235s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-89abd17a-371c-44e9-9350-19591031b70c" released by "delete_volume" :: held 0.618s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Created reservations ['a32d6f78-e543-4cba-8770-a3371bb1188f', 'e08e59f2-b8f6-4d74-80bd-c04b283c21b8', '5be71c17-38da-4d19-bb2a-9a73b4fc4042', '3b9d0c0c-a523-4b8d-b230-9c0b86bf92f0'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:07 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:35:07 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:07 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.241s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:35:07 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Deleted volume successfully.
Sep 11 06:35:07 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-78989255-f403-4207-8cca-d2f94d327c99 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-89abd17a-371c-44e9-9350-19591031b70c-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (193f8eca-f20e-42ed-b04c-8708cf9c3933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d99ae9f-3220-4f78-b9f7-a0f855082827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d99ae9f-3220-4f78-b9f7-a0f855082827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184273325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d79e32-2227-4ce5-9605-72a8242b892f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:08Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb865ba3-1c94-406e-8b90-a0aad92010d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb865ba3-1c94-406e-8b90-a0aad92010d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2316d147-d68a-4143-b39a-eecc606dc72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2316d147-d68a-4143-b39a-eecc606dc72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d79e32-2227-4ce5-9605-72a8242b892f', 'volume_name': 'volume-e1d79e32-2227-4ce5-9605-72a8242b892f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5d0477-239a-4197-85b7-7e9ec0a64f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5d0477-239a-4197-85b7-7e9ec0a64f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af658244-addb-40eb-9a6f-6dfdce3974fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Volume e1d79e32-2227-4ce5-9605-72a8242b892f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d79e32-2227-4ce5-9605-72a8242b892f', 'volume_size': 1}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184273325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d79e32-2227-4ce5-9605-72a8242b892f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:08Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Creating volume e1d79e32-2227-4ce5-9605-72a8242b892f {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:35:08 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:08 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f 1073741824
Sep 11 06:35:08 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:08 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f 1073741824" returned: 0 in 0.389s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:08 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f
Sep 11 06:35:08 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:08 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f" returned: 0 in 0.238s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af658244-addb-40eb-9a6f-6dfdce3974fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d79e32-2227-4ce5-9605-72a8242b892f', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274c40f4-2ad5-4d3c-8f71-6f83a67afea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:08 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Volume volume-e1d79e32-2227-4ce5-9605-72a8242b892f (e1d79e32-2227-4ce5-9605-72a8242b892f): created successfully
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274c40f4-2ad5-4d3c-8f71-6f83a67afea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:08 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (193f8eca-f20e-42ed-b04c-8708cf9c3933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:08 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-6cc0f58e-12eb-452f-897e-34f8574c6a29 tempest-ProjectReaderTests-1505299469 None] Created volume successfully.
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-e1d79e32-2227-4ce5-9605-72a8242b892f-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-e1d79e32-2227-4ce5-9605-72a8242b892f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-quobyte-e1d79e32-2227-4ce5-9605-72a8242b892f" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-e1d79e32-2227-4ce5-9605-72a8242b892f" acquired by "delete_volume" :: waited 0.016s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a67da-bcd0-476f-b17e-f7d2fb77cdfb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:09 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f
Sep 11 06:35:09 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:09 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f" returned: 0 in 0.343s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:09 devstack sudo[107156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f
Sep 11 06:35:09 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:09 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-e1d79e32-2227-4ce5-9605-72a8242b892f" returned: 0 in 0.235s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-e1d79e32-2227-4ce5-9605-72a8242b892f" released by "delete_volume" :: held 0.616s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Created reservations ['7bda115d-dad8-4d21-8910-45fcf63a3232', 'f9cfc2a5-87a8-40fc-bcb0-fd5e01ff8f14', 'a194d301-1ba8-4287-8989-971e524e994d', '26945964-6738-47f7-b79e-6480bb8eafb5'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:09 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:09 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:35:09 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:10 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.233s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:35:10 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Deleted volume successfully.
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-18deb059-3d65-4cc9-b565-338211b55886 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-e1d79e32-2227-4ce5-9605-72a8242b892f-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.flows.manager.create_volume [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (7d85de7d-420e-4235-89fa-d5a3b82c5d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9168b372-e4f4-432c-b35d-dc7164d7b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9168b372-e4f4-432c-b35d-dc7164d7b17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690097160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7421c5-9eea-4351-9ba0-625da23ca80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:11Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11d6941-14f6-4fc2-9820-52c54f22b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11d6941-14f6-4fc2-9820-52c54f22b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aed042c-269d-46ac-b615-d87b68d3d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aed042c-269d-46ac-b615-d87b68d3d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7421c5-9eea-4351-9ba0-625da23ca80d', 'volume_name': 'volume-eb7421c5-9eea-4351-9ba0-625da23ca80d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cd43b2-050a-41d5-8c99-717cbf84875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cd43b2-050a-41d5-8c99-717cbf84875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea47195-4924-419b-84df-f2c13a148657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:10 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Volume eb7421c5-9eea-4351-9ba0-625da23ca80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7421c5-9eea-4351-9ba0-625da23ca80d', 'volume_size': 1}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7e0317cd6810>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T04:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1690097160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7421c5-9eea-4351-9ba0-625da23ca80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aaf28b79fe4dfb9b5da5cb03149cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T04:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T04:35:11Z,use_quota=True,user_id='820fffdfd9cb446ba4b6ef800070b346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cade5e-c09c-4fae-a3a1-d4681a2fe1db),volume_type_id=47cade5e-c09c-4fae-a3a1-d4681a2fe1db)}" {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.remotefs [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Creating volume eb7421c5-9eea-4351-9ba0-625da23ca80d {{(pid=88109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Selected osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0 as target Quobyte volume. {{(pid=88109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 06:35:10 devstack cinder-volume[88109]: INFO cinder.volume.drivers.remotefs [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] casted to osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0
Sep 11 06:35:10 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d 1073741824 {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:10 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d 1073741824
Sep 11 06:35:10 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:11 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d 1073741824" returned: 0 in 0.419s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:11 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d
Sep 11 06:35:11 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:11 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d" returned: 0 in 0.260s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'} {{(pid=88109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea47195-4924-419b-84df-f2c13a148657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7421c5-9eea-4351-9ba0-625da23ca80d', 'volume_size': 1}' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42e852-71b8-40e8-9426-a41f99f4bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 06:35:11 devstack cinder-volume[88109]: INFO cinder.volume.flows.manager.create_volume [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Volume volume-eb7421c5-9eea-4351-9ba0-625da23ca80d (eb7421c5-9eea-4351-9ba0-625da23ca80d): created successfully
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42e852-71b8-40e8-9426-a41f99f4bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Flow 'volume_create_manager' (7d85de7d-420e-4235-89fa-d5a3b82c5d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 06:35:11 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-473e567f-16c2-4e04-83f4-7c6f97681a39 tempest-ProjectReaderTests-1505299469 None] Created volume successfully.
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-eb7421c5-9eea-4351-9ba0-625da23ca80d-delete_volume" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-eb7421c5-9eea-4351-9ba0-625da23ca80d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "cinder-quobyte-eb7421c5-9eea-4351-9ba0-625da23ca80d" by "delete_volume" {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-eb7421c5-9eea-4351-9ba0-625da23ca80d" acquired by "delete_volume" :: waited 0.015s {{(pid=88109) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d74a7-012c-4c9d-948b-f3c5bfde5e88]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 06:35:11 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:11 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d
Sep 11 06:35:11 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:12 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d" returned: 0 in 0.358s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:12 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d
Sep 11 06:35:12 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:12 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd/volume-eb7421c5-9eea-4351-9ba0-625da23ca80d" returned: 0 in 0.229s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-quobyte-eb7421c5-9eea-4351-9ba0-625da23ca80d" released by "delete_volume" :: held 0.626s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG cinder.quota [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Created reservations ['c0cc23ae-5194-44e7-9131-127d67099d1b', 'd430fb20-23da-4a59-8ee4-8f383a50fbcf', '4d0ff70e-dc07-4d85-a791-8e345dbe03b5', '196f5134-2db7-4c5a-898c-894b2b520b6c'] {{(pid=88109) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:12 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:35:12 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:12 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.232s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:35:12 devstack cinder-volume[88109]: INFO cinder.volume.manager [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Deleted volume successfully.
Sep 11 06:35:12 devstack cinder-volume[88109]: DEBUG cinder.coordination [None req-f8b23458-f44b-447c-9ea8-c2a308befa01 tempest-ProjectReaderTests-1505299469 None] Lock "cinder-eb7421c5-9eea-4351-9ba0-625da23ca80d-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=88109) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 06:35:22 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:SELECT=41,cinder:UPDATE=67,cinder:INSERT=11,cinder:DELETE=9 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:35:22 devstack cinder-volume[88109]: DEBUG dbcounter [-] [88109] Writing DB stats cinder:UPDATE=65,cinder:SELECT=43,cinder:INSERT=19,cinder:DELETE=3 {{(pid=88109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0': None} {{(pid=88109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG cinder.volume.drivers.quobyte [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38f05802-c275-45b7-a00c-e0d2ad39a9a0'] {{(pid=88109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.lockutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 06:35:31 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd
Sep 11 06:35:31 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 06:35:31 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG oslo_concurrency.processutils [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ccdcd9c30c7796d123edcc3dc9d9ecd" returned: 0 in 0.227s {{(pid=88109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG cinder.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Notifying Schedulers of capabilities ... {{(pid=88109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG oslo_service.periodic_task [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] Running periodic task VolumeManager._thread_info {{(pid=88109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread count: 28 {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 06:35:31 devstack cinder-volume[88109]: DEBUG cinder.volume.manager [None req-5b8a591d-b9ca-4ffd-b34f-569a02e3a860 None None] thread info: [<_MainThread(MainThread, started 138551857139840)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138551743311808)>, <Thread(Thread-3 (stat_writer), started daemon 138551741823680)>, <Thread(Rabbit-heartbeat, started daemon 138551746251392)>, <Thread(Thread-5 (_runner), started daemon 138551740607680)>, <Thread(Thread-7 (_runner), started daemon 138551740658560)>, <Thread(fd_logger, started daemon 138551740320640)>, <Thread(privsep_reader, started daemon 138551738703872)>, <Thread(tpool_thread_0, started daemon 138551732012736)>, <Thread(tpool_thread_1, started daemon 138551723620032)>, <Thread(tpool_thread_2, started daemon 138551715227328)>, <Thread(tpool_thread_3, started daemon 138551706834624)>, <Thread(tpool_thread_4, started daemon 138551698441920)>, <Thread(tpool_thread_5, started daemon 138551690049216)>, <Thread(tpool_thread_6, started daemon 138551681656512)>, <Thread(tpool_thread_7, started daemon 138551673263808)>, <Thread(tpool_thread_8, started daemon 138551664871104)>, <Thread(tpool_thread_9, started daemon 138551656478400)>, <Thread(tpool_thread_10, started daemon 138551648085696)>, <Thread(tpool_thread_11, started daemon 138551639692992)>, <Thread(tpool_thread_12, started daemon 138551631300288)>, <Thread(tpool_thread_13, started daemon 138551622907584)>, <Thread(tpool_thread_14, started daemon 138551614514880)>, <Thread(tpool_thread_15, started daemon 138551606122176)>, <Thread(tpool_thread_16, started daemon 138551597729472)>, <Thread(tpool_thread_17, started daemon 138551589336768)>, <Thread(tpool_thread_18, started daemon 138551580944064)>, <Thread(tpool_thread_19, started daemon 138551572551360)>] {{(pid=88109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}